-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Automate upstream llama.cpp sync #1910
Comments
If you are able to build, could you share the llama_cpp.py (updated) and the version of llama.cpp you're using? Thanks in advance! |
Unfortunately I'm not. Currently attempting to get afa8a9e of the upstream project running. There are lots of breaking changes I'd have to understand first and which will affect more than just I have no prior experience with this project nor llama.cpp. Just gave it a shot because I got impatient waiting for the deepseek tokenizer. |
Maybe you can try my repaired version. #1901 |
Yes, can confirm this works. Can use Deepseek R1 distills now. Great work! |
I'm trying to build with a newer upstream version of llama.cpp. Syncing the changes from upstream
llama.h
intollama_cpp.py
is quite a toil. Has anyone (successfully) attempted to use LLM assistance to make it less painful?The text was updated successfully, but these errors were encountered: