Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat] Create validator to check text LLM response but to skip tool (function) call. #1195

Open
whysage opened this issue Dec 10, 2024 · 4 comments
Labels
enhancement New feature or request

Comments

@whysage
Copy link

whysage commented Dec 10, 2024

Description
Please explain if it is currently possible to create validator to check text LLM response (common message in completion.choices[0].message) but to skip tool (function) call (completion.choices[0].message.tool_calls).

Why is this needed
In my case, LLM can pick regular message response or perform a tool call. Only text regular message response must be validated.

Implementation details
It would be great if this check could be inside validator (not like if statement after getting LLM results)

End result
Create many validators only for text response.

@whysage whysage added the enhancement New feature or request label Dec 10, 2024
Copy link

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 14 days.

@github-actions github-actions bot added the Stale label Jan 10, 2025
@595972434
Copy link

Hi @whysage , I met same issue. In my case, I also need LLM to can pick tool call from tool list, but the guard returns ValidationOutcome which only contains the tool calling params.
Do you know if it's possible to get the function name from validator output?

@github-actions github-actions bot removed the Stale label Jan 16, 2025
@whysage
Copy link
Author

whysage commented Jan 17, 2025

Hi @whysage , I met same issue. In my case, I also need LLM to can pick tool call from tool list, but the guard returns ValidationOutcome which only contains the tool calling params. Do you know if it's possible to get the function name from validator output?

Hi @595972434, unfortunately I do not have solution for this now.

@595972434
Copy link

Thanks for your reply @whysage. In this case, I can only use guard validator separately😢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants