[Refactor] Refactor Lagent #97

Harold-lkk · 2024-01-25T03:54:57Z

We have unified the interfaces of our models, including the functions generate, chat, stream_generate, tokenize.
To enhance flexibility and efficiency, Action is now compatible with Toolkit. Multiple methods within the same class can now be automatically transformed into multiple tools, and the returned descriptions can seamlessly integrate into OpenAI's function calls.
The interface of the Agent has been optimized to closely resemble that of the Model, enabling a seamless transition between models and intelligent agent

update main

* redesign BaseModel * update docstring * update baseModel

* [Fix]: fix turbomind (#81) fix turbomind * add parsers * skip ActionReturn in postprocessing * check existence of API name * add exception catch in action executing * validate input arguments * modify returned structure of `get_actions_info` * adapt tools to the new protocol * remove `LLMQA` action --------- Co-authored-by: RangiLyu <[email protected]> Co-authored-by: wangzy <[email protected]>

* add new tools * update PPT * chores * update action module init --------- Co-authored-by: wangzy <[email protected]>

* implement `chat` * update agent interfaces * redundancy reduction --------- Co-authored-by: wangzy <[email protected]>

* [Fix]: fix turbomind (#81) fix turbomind * Feature: lmdeploy_wrapper implemented BaseMode * remove comments of 'llms.__init__' * update of 'llms.__init__' * update lmdepoly_wrapper with 'gen_params' * add property 'state_map' in __init_ and use APIClient to stream infer_ * func 'generate' in LMDeployClient with 'APIClient' * fix bug of TritonClient * add docstr for LMDeployPipeline & LMDeployServer * class LMDeployClient inherits class LMDeployServer * LMDeployClient with BaseModel.__init__ and use field 'max_tokens' control model output * add TODO * move 'import mmengine' to func '_update_gen_params' --------- Co-authored-by: RangiLyu <[email protected]>

fix APITemplateParser object is not callable Co-authored-by: wangzy <[email protected]>

* [Feat] support StreamAgent * update `StreamAgent` * truncate inner history --------- Co-authored-by: wangzy <[email protected]>

* Feature: huggingface implemented BaseMode * hf llm implemented BaseMode * fix bug of hf llm * inject attention_mask during inference * remove unnecessary

* redundancy reduction * add `tool_api` to annotate a tool method * improve json parsing * enhance parsers * update README.md --------- Co-authored-by: wangzy <[email protected]>

improve `tool_api` Co-authored-by: wangzy <[email protected]>

init the docs Co-authored-by: wangzy <[email protected]>

* modify the struction of action results * fix docstrings --------- Co-authored-by: wangzy <[email protected]>

fix rtd config Co-authored-by: wangzy <[email protected]>

* add ipython interpreter * update requirements * remove `return_list` argument --------- Co-authored-by: wangzy <[email protected]>

fix the fallback value Co-authored-by: wangzy <[email protected]>

* update cfg & fix bug of StreamAgent * fix bug of func 'stream_chat' * streamlit demo with full response * enchance stream chat * fix bug of stream chat * fix and file rename * add exception catch for func 'chat' --------- Co-authored-by: liujiangning <[email protected]>

* add `get_started` chapter * fix docstrings * add action.md * add zh docs --------- Co-authored-by: wangzy <[email protected]>

fix `BaseAPIModel` chat returns Co-authored-by: wangzy <[email protected]>

* add warn for func 'generate_from_template' * clearer alerts for deprecation * clearer alerts for deprecation

Harold-lkk and others added 24 commits September 23, 2023 00:47

Merge pull request #1 from InternLM/main

06bedec

update main

Merge branch 'main' of github.com:Harold-lkk/lagent into main

b49397a

Merge branch 'main' of https://github.com/InternLM/lagent into main

93162b2

Merge branch 'main' of https://github.com/InternLM/lagent into main

740c3f9

Feature: redesign BaseModel (#80)

e46e59c

* redesign BaseModel * update docstring * update baseModel

[Feature] add tools (#89)

c42c884

* add new tools * update PPT * chores * update action module init --------- Co-authored-by: wangzy <[email protected]>

rename func 'completion' to 'generate' (#90)

fdaacb8

[Feature] support batch inference in API models (#91)

adefd97

* implement `chat` * update agent interfaces * redundancy reduction --------- Co-authored-by: wangzy <[email protected]>

Fix APITemplateParser object is not callable (#95)

54e5b61

fix APITemplateParser object is not callable Co-authored-by: wangzy <[email protected]>

[Feat] support StreamAgent (#82)

a53bad2

* [Feat] support StreamAgent * update `StreamAgent` * truncate inner history --------- Co-authored-by: wangzy <[email protected]>

[Feat] hf llm implemented BaseMode (#92)

bdd6a9b

* Feature: huggingface implemented BaseMode * hf llm implemented BaseMode * fix bug of hf llm * inject attention_mask during inference * remove unnecessary

[Feature] support building tool descriptions automatically (#96)

799c6a3

* redundancy reduction * add `tool_api` to annotate a tool method * improve json parsing * enhance parsers * update README.md --------- Co-authored-by: wangzy <[email protected]>

Enhance tool annotation (#98)

1b5fd99

improve `tool_api` Co-authored-by: wangzy <[email protected]>

[Docs] initialize the documentation (#99)

016ee62

init the docs Co-authored-by: wangzy <[email protected]>

Modify the structure of ActionReturn's result (#102)

1292ea7

* modify the struction of action results * fix docstrings --------- Co-authored-by: wangzy <[email protected]>

Fix .readthedocs.yml (#104)

4879194

fix rtd config Co-authored-by: wangzy <[email protected]>

[Feature] support IPython interpreter action (#103)

85853da

* add ipython interpreter * update requirements * remove `return_list` argument --------- Co-authored-by: wangzy <[email protected]>

Fix BINGMap key (#105)

a2a0d91

fix the fallback value Co-authored-by: wangzy <[email protected]>

[Docs] Add action tutorials (#107)

39e00f2

* add `get_started` chapter * fix docstrings * add action.md * add zh docs --------- Co-authored-by: wangzy <[email protected]>

Fix returns of OpenAI interface (#108)

b5533b0

fix `BaseAPIModel` chat returns Co-authored-by: wangzy <[email protected]>

Feat: add warn for func 'generate_from_template' (#109)

1eb10a3

* add warn for func 'generate_from_template' * clearer alerts for deprecation * clearer alerts for deprecation

Harold-lkk changed the title ~~[Version] 0.2.0~~ [Refactor] Refactor Lagent Jan 30, 2024

braisedpork1964 approved these changes Jan 30, 2024

View reviewed changes

Harold-lkk merged commit 95b68c8 into main Jan 30, 2024
1 check passed

Harold-lkk deleted the dev branch July 11, 2024 03:27

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Refactor] Refactor Lagent #97

[Refactor] Refactor Lagent #97

Harold-lkk commented Jan 25, 2024 •

edited

Loading

[Refactor] Refactor Lagent #97

[Refactor] Refactor Lagent #97

Conversation

Harold-lkk commented Jan 25, 2024 • edited Loading

Harold-lkk commented Jan 25, 2024 •

edited

Loading