v0.2.0
What's Changed
-
Stream Output: Provides the stream_chat interface for streaming output, allowing cool streaming demos right at your local setup.
-
Interfacing is unified, with a comprehensive design upgrade for enhanced extensibility, including:
- Model: Whether it's the OpenAI API, Transformers, or LMDeploy inference acceleration framework, you can seamlessly switch between models.
- Action: Simple inheritance and decoration allow you to create your own personal toolkit, adaptable to both InternLM and GPT.
- Agent: Consistent with the Model's input interface, the transformation from model to intelligent agent only takes one step, facilitating the exploration and implementation of various agents.
-
Documentation has been thoroughly upgraded with full API documentation coverage.
Welcome to watch our demo at https://www.youtube.com/watch?v=YAelRLi0Zak