Skip to content

Commit

Permalink
Improve docs wording
Browse files Browse the repository at this point in the history
  • Loading branch information
kthui committed Apr 4, 2024
1 parent b26d5a0 commit c50d0cc
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -624,8 +624,8 @@ for more details on how to host a decoupled model.

Starting from 24.04, `async def execute(self, requests):` is supported for
decoupled Python models. Its coroutine will be executed by an AsyncIO event loop
shared with requests executing in a model instance. The next request for the
model instance can start executing while the current request is waiting.
shared with requests executing in the same model instance. The next request for
the model instance can start executing while the current request is waiting.

This is useful for minimizing the number of model instances for models that
spend the majority of its time waiting, given requests can be executed
Expand Down

0 comments on commit c50d0cc

Please sign in to comment.