Skip to content

0.12.2

Compare
Choose a tag to compare
@b4rtaz b4rtaz released this 15 Feb 10:52
· 17 commits to main since this release

This version adds support for DeepSeek R1 Distill Llama models. You can now download and use the DeepSeek R1 Distill Llama 8B Q40 model.

python launch.py deepseek_r1_distill_llama_8b_q40