How to disable hf_transfer?

[vabatista]

I'm trying to download LLama 3.1 8B instruct. Litgpt is hagging or rasing exception:

Exception: Failed too many failures in parallel (3): PyErr { type: <class 'Exception'>, value: Exception('Error while downloading: reqwest::Error { kind: Body, source: hyper::Error(Body, Os { code: 104, kind: ConnectionReset, message: "Connection reset by peer" }) }'), traceback: None } (NoPermits)
and
File "/home/users/vabatista/mamba3/envs/sesame2/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 439, in http_get raise RuntimeError( RuntimeError: An error occurred while downloading using hf_transfer. Consider disabling HF_HUB_ENABLE_HF_TRANSFER for better error handling.

I tried to disable HF_HUB_ENABLE_HF_TRANSFER=0 in environment, but has no effect. In first output line of litgpt download command it prints Setting HF_HUB_ENABLE_HF_TRANSFER=1

What I'm doing wrong?

[Andrei-Aksionov]

Hello @vabatista

To better isolate the problem, you can comment out this code
https://github.com/Lightning-AI/litgpt/blob/main/litgpt/scripts/download.py#L79-L82

and check does it help or not.

Consider disabling HF_HUB_ENABLE_HF_TRANSFER for better error handling.

It might not be the problem with the hf_transfer itself, just the error it produces is not clear enough.

[rasbt]

Based on my crude investigation yesterday, it seems that once hf_transfer is installed it's used irregardless of the flag (#1899). I recommend trying pip uninstall hf_transfer then trying again. And if the problem persist, I would additionally comment out the lines mentioned above.

I am closing this issue as potentially addressed to clear out the issue tracker a bit, but please feel free to reopen if the problem persists.