Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LiteLLM integration #78

Closed
wants to merge 6 commits into from
Closed

LiteLLM integration #78

wants to merge 6 commits into from

Conversation

pjbedard
Copy link
Contributor

@pjbedard pjbedard commented Dec 5, 2024

Integrated LiteLLM into paios to facilitate the interaction with the LLMs of various providers using a standard interface.

  • introduced Llm model
  • introduced ModelsManager, that initializes and uses the LiteLLM router to interact with models from different providers (at present time, only Ollama and OpenAI models are loaded during the ModelsManager's initialization)
  • implemented Llm-related API endpoints:
    • get-all
    • get
    • completion, which accepts the OpenAI-style parameters as well as provider-specific parameters

@pjbedard pjbedard requested review from samj and quaid as code owners December 5, 2024 16:31
@github-advanced-security
Copy link

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.

Copy link

sonarqubecloud bot commented Dec 5, 2024

@pjbedard pjbedard self-assigned this Dec 5, 2024
@pjbedard pjbedard closed this Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant