You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat: Add log probabilities and number of input tokens to additional outputs#75
Merged
kthui merged 5 commits intomaintriton-inference-server/vllm_backend:mainfrom jacky-vllm-logprobstriton-inference-server/vllm_backend:jacky-vllm-logprobsCopy head branch name to clipboardDec 5, 2024
