找不到llama_cpp模块

[smashdog]

[AlekPet]

Hi. This is not my extension, most likely you need to read here https://github.com/thisjam/comfyui-sixgod_prompt , how to install lllama.cpp , it's all there. How to compile using cmake and so on...

大模型配置（可用于翻译和随机灵感）
安装 llama_cpp_python

方式一、参考：https://github.com/abetlen/llama-cpp-python
方式二、(推荐)llama-cpp-python的gpu离线包下载地址，自行下载对于版本下载安装
https://abetlen.github.io/llama-cpp-python/whl/cu121/
https://abetlen.github.io/llama-cpp-python/whl/cu122/
https://abetlen.github.io/llama-cpp-python/whl/cu123/
https://abetlen.github.io/llama-cpp-python/whl/cu124/
大模型下载（需要.gguf格式）

建议千问大模型，推荐qwen1_5-4b-chat-q2_k.gguf
地址：https://huggingface.co/Qwen