Skip to content

Commit

Permalink
Enable streaming responses
Browse files Browse the repository at this point in the history
LLM's use of stream_options is now supported by Venice API
Closes #3
  • Loading branch information
ar-jan committed Jan 6, 2025
1 parent 9403711 commit d5a64c1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llm_venice.py
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,6 @@ def register_models(register):
model_id=f"venice/{model_id}",
model_name=model_id,
api_base="https://api.venice.ai/api/v1",
can_stream=False
can_stream=True
)
)

0 comments on commit d5a64c1

Please sign in to comment.