0.12.2
This version adds support for DeepSeek R1 Distill Llama models. You can now download and use the DeepSeek R1 Distill Llama 8B Q40 model.
python launch.py deepseek_r1_distill_llama_8b_q40
This version adds support for DeepSeek R1 Distill Llama models. You can now download and use the DeepSeek R1 Distill Llama 8B Q40 model.
python launch.py deepseek_r1_distill_llama_8b_q40