Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PEFT backend is required error when loading lora #347

Open
smarmet opened this issue Jan 10, 2025 · 0 comments
Open

PEFT backend is required error when loading lora #347

smarmet opened this issue Jan 10, 2025 · 0 comments

Comments

@smarmet
Copy link

smarmet commented Jan 10, 2025

Expected Behavior

The lora loads and generation completes

Actual Behavior

Generation fails during the CogVideoX Model Loader node with error "PEFT backend is required for this method."

Steps to Reproduce

Add CogVideo LoraSelect Comfy node to cogvideox_1_0_5b_I2V_02.json example workflow

Debug Logs

Merging rank 128 LoRA weights from C:/AI/Models/Video/CogX/lora/test-3000.safetensors with strength 1.0
!!! Exception during processing !!! PEFT backend is required for this method.
Traceback (most recent call last):
  File "C:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 327, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 202, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "C:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-CogVideoXWrapper\model_loading.py", line 832, in loadmodel
    pipe.load_lora_weights(l['path'], weight_name=l['path'].split("/")[-1], lora_rank=lora_rank, adapter_name=adapter_name)
  File "C:\AI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\diffusers\loaders\lora_pipeline.py", line 2666, in load_lora_weights
    raise ValueError("PEFT backend is required for this method.")
ValueError: PEFT backend is required for this method.

Other

Windows 10, comfyui portable. peft is installed, versions below

PS C:\AI\ComfyUI_windows_portable> .\python_embeded\python.exe -m pip install -U peft
Requirement already satisfied: peft in c:\users\smarmet\appdata\roaming\python\python311\site-packages (0.14.0)
Requirement already satisfied: numpy>=1.17 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (1.26.4)
Requirement already satisfied: packaging>=20.0 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (24.2)
Requirement already satisfied: psutil in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (6.1.0)
Requirement already satisfied: pyyaml in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (6.0.2)
Requirement already satisfied: torch>=1.13.0 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (2.5.1+cu124)
Requirement already satisfied: transformers in c:\ai\comfyui_windows_portable\python_embeded\lib\site-packages (from peft) (4.47.1)
Requirement already satisfied: tqdm in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (4.67.1)
Requirement already satisfied: accelerate>=0.21.0 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (1.2.0)
Requirement already satisfied: safetensors in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from peft) (0.4.5)
Requirement already satisfied: huggingface-hub>=0.25.0 in c:\ai\comfyui_windows_portable\python_embeded\lib\site-packages (from peft) (0.25.2)
Requirement already satisfied: filelock in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from huggingface-hub>=0.25.0->peft) (3.16.1)
Requirement already satisfied: fsspec>=2023.5.0 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from huggingface-hub>=0.25.0->peft) (2024.10.0)
Requirement already satisfied: requests in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from huggingface-hub>=0.25.0->peft) (2.32.3)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from huggingface-hub>=0.25.0->peft) (4.12.2)
Requirement already satisfied: networkx in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from torch>=1.13.0->peft) (3.4.2)
Requirement already satisfied: jinja2 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from torch>=1.13.0->peft) (3.1.4)
Requirement already satisfied: sympy==1.13.1 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from torch>=1.13.0->peft) (1.13.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from sympy==1.13.1->torch>=1.13.0->peft) (1.3.0)
Requirement already satisfied: colorama in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from tqdm->peft) (0.4.6)
Requirement already satisfied: regex!=2019.12.17 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from transformers->peft) (2024.11.6)
Requirement already satisfied: tokenizers<0.22,>=0.21 in c:\ai\comfyui_windows_portable\python_embeded\lib\site-packages (from transformers->peft) (0.21.0)
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from jinja2->torch>=1.13.0->peft) (3.0.2)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from requests->huggingface-hub>=0.25.0->peft) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from requests->huggingface-hub>=0.25.0->peft) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from requests->huggingface-hub>=0.25.0->peft) (2.2.3)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\smarmet\appdata\roaming\python\python311\site-packages (from requests->huggingface-hub>=0.25.0->peft) (2024.8.30)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant