ValueError: Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.

[Juvenilecris]

Reminder

• I have read the README and searched the existing issues.

System Info

None

Reproduction

[rank4]: Traceback (most recent call last):
[rank4]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 23, in
[rank4]: launch()
[rank4]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 19, in launch
[rank4]: run_exp()
[rank4]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/tuner.py", line 46, in run_exp
[rank4]: model_args, data_args, training_args, finetuning_args, generating_args = get_train_args(args)
[rank4]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 231, in get_train_args
[rank4]: raise ValueError("Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.")
[rank4]: ValueError: Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.
[2024-12-31 10:34:03,344] [INFO] [comm.py:652:init_distributed] cdb=None
[2024-12-31 10:34:03,344] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
[rank0]: Traceback (most recent call last):
[rank0]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 23, in
[rank0]: launch()
[rank0]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 19, in launch
[rank0]: run_exp()
[rank0]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/tuner.py", line 46, in run_exp
[rank0]: model_args, data_args, training_args, finetuning_args, generating_args = get_train_args(args)
[rank0]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 231, in get_train_args
[rank0]: raise ValueError("Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.")
[rank0]: ValueError: Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.
[2024-12-31 10:34:03,945] [INFO] [comm.py:652:init_distributed] cdb=None
[2024-12-31 10:34:03,953] [INFO] [comm.py:652:init_distributed] cdb=None
[rank5]: Traceback (most recent call last):
[rank5]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 23, in
[rank5]: launch()
[rank5]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 19, in launch
[rank5]: run_exp()
[rank5]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/tuner.py", line 46, in run_exp
[rank5]: model_args, data_args, training_args, finetuning_args, generating_args = get_train_args(args)
[rank5]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 231, in get_train_args
[rank5]: raise ValueError("Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.")
[rank5]: ValueError: Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.
[rank3]: Traceback (most recent call last):
[rank3]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 23, in
[rank3]: launch()
[rank3]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 19, in launch
[rank3]: run_exp()
[rank3]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/tuner.py", line 46, in run_exp
[rank3]: model_args, data_args, training_args, finetuning_args, generating_args = get_train_args(args)
[rank3]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 231, in get_train_args
[rank3]: raise ValueError("Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.")
[rank3]: ValueError: Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.
[2024-12-31 10:34:04,257] [INFO] [comm.py:652:init_distributed] cdb=None
[2024-12-31 10:34:04,273] [INFO] [comm.py:652:init_distributed] cdb=None
[rank2]: Traceback (most recent call last):
[rank2]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 23, in
[rank2]: launch()
[rank2]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 19, in launch
[rank2]: run_exp()
[rank2]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/tuner.py", line 46, in run_exp
[rank2]: model_args, data_args, training_args, finetuning_args, generating_args = get_train_args(args)
[rank2]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 231, in get_train_args
[rank2]: raise ValueError("Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.")
[rank2]: ValueError: Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.
[rank1]: Traceback (most recent call last):
[rank1]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 23, in
[rank1]: launch()
[rank1]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/launcher.py", line 19, in launch
[rank1]: run_exp()
[rank1]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/tuner.py", line 46, in run_exp
[rank1]: model_args, data_args, training_args, finetuning_args, generating_args = get_train_args(args)
[rank1]: File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 231, in get_train_args
[rank1]: raise ValueError("Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.")
[rank1]: ValueError: Please use scripts/pissa_init.py to initialize PiSSA in DeepSpeed ZeRO-3.

Expected behavior

No response

Others

No response