Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

384 Open 1,274 Closed
384 Open 1,274 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

The service crashes if the model takes a long time to respond grpc
#3168 opened May 31, 2024 by yurkoff-mv
12
NotImplementedError: Cannot copy out of meta tensor; no data! + Models not generating output text
#3167 opened May 31, 2024 by bjorquera1
3
Make torchserve-kfs docker image multiplatform enhancement New feature or request kfserving
#3161 opened May 25, 2024 by DanielTemesgen
1
Enable token authentication as default enhancement New feature or request p0 high priority security
#3157 opened May 23, 2024 by lxning v0.12.0
@udaij12
install dependency via conda enhancement New feature or request p0 high priority
#3156 opened May 22, 2024 by lxning v0.12.0
@namannandan
Limit resource in docker compose and worker in model triaged Issue has been reviewed and triaged
#3150 opened May 21, 2024 by ToanLyHoa
@agunapal
2
Continuous Batching does not work with newest transformer issue
#3148 opened May 21, 2024 by udaij12
@mreso @lxning
question to model inference optimization triaged Issue has been reviewed and triaged
#3134 opened May 4, 2024 by geraldstanje
@agunapal
8
If micro_batch_size of micro-batch is set to 1, then model inference is still batch processing?
#3120 opened Apr 29, 2024 by pengxin233
1
CUDA out of Memory with low Memory Utilization (CUDA error: device-side assert triggered)
#3114 opened Apr 25, 2024 by emilwallner
6
Load model failed - error: Worker died
#3104 opened Apr 23, 2024 by geraldstanje
6
Update large_models/gpt_fast to llama3
#3102 opened Apr 22, 2024 by mreso
@mreso
Update large_models/tp_llama to llama3
#3101 opened Apr 22, 2024 by mreso
@mreso
Update large_models/inferentia2/llama2 to Llama3
#3100 opened Apr 22, 2024 by mreso
@lxning
Update cpp/llamacpp to Llama 3
#3098 opened Apr 22, 2024 by mreso
@mreso
1
Metrics collector crashes when NVIDIA MIGs are present
#3090 opened Apr 16, 2024 by UrkoAT
2
Serve multiple models with both CPU and GPU question Further information is requested triaged Issue has been reviewed and triaged
#3078 opened Apr 10, 2024 by hungtrieu07
4
TorchServe linux aarch64 plan dependencies Pull requests that update a dependency file enhancement New feature or request
#3072 opened Apr 3, 2024 by agunapal
1 of 4 tasks
@agunapal
Torchserve error for more than 14 python async requests on workflow
#3069 opened Apr 3, 2024 by bennykins
2
[RFC]: Deprecation notice for TorchText installation in TorchServe deprecation
#3066 opened Apr 2, 2024 by agunapal
2
v0.10.0 OpenAPI specification does not validate OIP
#3058 opened Mar 30, 2024 by ericphanson
CPU Launcher fails available check with venv
#3049 opened Mar 27, 2024 by ElfoLiNk
3
\ready API for Kubernetes probe to know when TorchServe backend is ready to receive traffic kubernetes
#3047 opened Mar 27, 2024 by agunapal
1
gRPC Model Metadata using Open Inference Protocol OIP
#3045 opened Mar 26, 2024 by harshita-meena
1
Custom class handler missing BaseHandler documentation Improvements or additions to documentation
#3042 opened Mar 26, 2024 by swstack v0.11.0
ProTip! Find all open issues with in progress development work with linked:pr.