Skip to content

Issues: triton-inference-server/onnxruntime_backend

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
72 Open 37 Closed
72 Open 37 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Improve autocomplete to make it more robust against partial model configuration
#113 opened Apr 20, 2022 by tanmayv25
Triton-OnnxRt- TRT performance i
#30 opened Feb 19, 2021 by mayani-nv
4
CPU inference is much slower than with ONNX Runtime directly more-info-needed Waiting for more information
#34 opened Mar 19, 2021 by artmatsak
@askhade
10
In Dockerfile gen script, CUDNN_VERSION should be obtained from docker image
#52 opened Jul 13, 2021 by GuanLuo
Model loading failure: densenet_onnx fails to load due to "pthread_setaffinity_np" failure
#86 opened Nov 30, 2021 by shrek
4
Error in onnxruntime-openvino backend when run with Triton
#89 opened Dec 7, 2021 by mayani-nv
7
tritonclient.utils.InferenceServerException: [StatusCode.INTERNAL] onnx runtime error 2: not enough space: expected 270080, got 261760
#95 opened Jan 7, 2022 by piekey1994
@askhade
7
Not able to load simple iris model: Getting error: Unsupported ONNX Type 'ONNX_TYPE_SEQUENCE'
#94 opened Jan 12, 2022 by KshitizLohia
13
Half of CPU threads not utilized when running GPU model
#96 opened Jan 26, 2022 by wilsoncai1992
Bug for Built target onnxruntime_providers
#100 opened Feb 21, 2022 by SimonLliu
Expose all string key/value configs instead of doing it piecemeal. enhancement New feature or request
#107 opened Mar 17, 2022 by pranavsharma
Yolov3 onnx model not load
#109 opened Mar 31, 2022 by josephwnv
5
Shared weights whenever multiple instances medium
#18 opened Nov 30, 2020 by DavidLangworthy
10
Batch Support Error Triton ONNX Backend
#111 opened Apr 5, 2022 by sarperkilic
7
model with triton inference server is 3x slower than the model in ORT directly (using gpu in both)
#116 opened May 4, 2022 by farzanehnakhaee70
3
perf_analyzer failing with inputs -1 dimension
#121 opened May 17, 2022 by aishanibhalla
14
ORT_DISABLE_ALL optimization level
#122 opened Jun 2, 2022 by dryarullin
1
Allow to specify tensorrt cache path per version
#124 opened Jul 4, 2022 by fran6co
Cannot build r22.03 onnxruntime_backend with tensorrt
#125 opened Jul 5, 2022 by ZJU-lishuang
2
Memory Leak When Using ONNXRuntime With OpenVino EP
#132 opened Jul 26, 2022 by narolski
6
Allow Usage of Intel oneDNN EP For ONNX Backend
#133 opened Jul 27, 2022 by narolski
2
onnxruntime inference seesion params setting
#136 opened Jul 29, 2022 by zhaozhiming37
How to inference with model(onnx) converted by MMdeploy?
#138 opened Aug 3, 2022 by Monalsingh
Disable enable_mem_pattern not working
#140 opened Aug 16, 2022 by chiehpower
1
Limited GPU Memory Utilization in ColBERT Deployment
#293 opened Jan 17, 2025 by nauyan
ProTip! Find all open issues with in progress development work with linked:pr.