Skip to content

Commit

Permalink
Address comment
Browse files Browse the repository at this point in the history
  • Loading branch information
krishung5 committed Nov 8, 2023
1 parent 543187c commit b8f3375
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -641,8 +641,9 @@ sequence_batching {
}
```

For non-decoupled models, a `None` object must be appended to the response list
for the rescheduled request. For example:
For non-decoupled models, there can only be one response for each request. Since
the rescheduled request is the same as the original, you must append a `None`
object to the response list for the rescheduled request. For example:

```python
import triton_python_backend_utils as pb_utils
Expand Down

0 comments on commit b8f3375

Please sign in to comment.