You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
We are currently unable to (properly) use TensorRT in Triton because there is a bug in the onnxruntime < 1.14.0 that makes TensorRT engine caching unreliable. This bug has been fixed in version 1.14.0, so it would be nice if Triton's backend could be updated to that version.
Describe the solution you'd like
Update the backend to use onnxruntime 1.14.0 or later.
Describe alternatives you've considered
To not use TensorRT for now.
Additional context
N/A
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
We are currently unable to (properly) use TensorRT in Triton because there is a bug in the onnxruntime < 1.14.0 that makes TensorRT engine caching unreliable. This bug has been fixed in version 1.14.0, so it would be nice if Triton's backend could be updated to that version.
Describe the solution you'd like
Update the backend to use onnxruntime 1.14.0 or later.
Describe alternatives you've considered
To not use TensorRT for now.
Additional context
N/A
The text was updated successfully, but these errors were encountered: