You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While performing inference with starcoder, I encountered the following errors:
bin [ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so
[ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
[ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32
... (abbreviated for brevity, continue with the anonymized log) ...
KeyError: 'LD_LIBRARY_PATH'
I installed the dependencies as specified in the repo. I'd appreciate any guidance on resolving this problem.
The text was updated successfully, but these errors were encountered:
While performing inference with starcoder, I encountered the following errors:
I installed the dependencies as specified in the repo. I'd appreciate any guidance on resolving this problem.
The text was updated successfully, but these errors were encountered: