Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OpenRouter: use include_reasoning param to get R1 reasoning tokens #3946

Open
Patrick-Erichsen opened this issue Feb 3, 2025 · 0 comments
Open
Assignees
Labels
area:configuration Relates to configuration options good-first-issue Suggested issue for new contributors kind:enhancement Indicates a new feature request, imrovement, or extension

Comments

@Patrick-Erichsen
Copy link
Collaborator

Patrick-Erichsen commented Feb 3, 2025

Problem

From @manmal 's original message: #3832 (comment)

I'm using the current pre-release 0.9.259 with OpenRouter:

    {
      "title": "DeepSeek R1",
      "provider": "openai",
      "model": "deepseek/deepseek-r1",
      "apiKey": <API_KEY>,
      "completionOptions": {},
      "apiBase": "https://openrouter.ai/api/v1"
    },

Which works great! The output is super useful.

However, the reasoning output is not displayed. It seems that OpenRouter needs include_reasoning be set to true, or it will just skip the <think/> output: https://openrouter.ai/announcements/reasoning-tokens-for-thinking-models

Solution

No response

@Patrick-Erichsen Patrick-Erichsen added the good-first-issue Suggested issue for new contributors label Feb 3, 2025
@dosubot dosubot bot added area:configuration Relates to configuration options kind:enhancement Indicates a new feature request, imrovement, or extension labels Feb 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:configuration Relates to configuration options good-first-issue Suggested issue for new contributors kind:enhancement Indicates a new feature request, imrovement, or extension
Projects
None yet
Development

No branches or pull requests

1 participant