Extra版本在训练的时候找不到emo.pt

[oszc]

我并没有训练表情？为什么要找emo.pt? 而wav文件是一定存在的...预处理配置都是正确的。

PS D:\ai_bert_vits2\Bert-VITS2-Extra> torchrun --nproc_per_node=1 train_ms.py
[2024-01-17 15:00:26,809] torch.distributed.elastic.multiprocessing.redirects: [WARNING] NOTE: Redirects are currently not supported in Windows or MacOs.
[W socket.cpp:663] [c10d] The client socket has failed to connect to [Justin]:29500 (system error: 10049 - 在其上下文中，该请求的地址无效。).
加载环境变量
MASTER_ADDR: 127.0.0.1,
MASTER_PORT: 29500,
WORLD_SIZE: 1,
RANK: 0,
LOCAL_RANK: 0
[W socket.cpp:663] [c10d] The client socket has failed to connect to [Justin]:29500 (system error: 10049 - 在其上下文中，该请求的地址无效。).
01-17 15:00:30 INFO | data_utils.py:65 | Init dataset...
100%|████████████████████████████████████████████████████████████████████████████████████████████████████| 4133/4133 [00:00<00:00, 45376.41it/s]
01-17 15:00:30 INFO | data_utils.py:80 | skipped: 0, total: 4133
01-17 15:00:30 INFO | data_utils.py:65 | Init dataset...
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<?, ?it/s]
01-17 15:00:30 INFO | data_utils.py:80 | skipped: 0, total: 4
Using noise scaled MAS for VITS2
Initialize wavlm
list index out of range
Some weights of the model checkpoint at ./slm/wavlm-base-plus were not used when initializing WavLMModel: ['encoder.pos_conv_embed.conv.weight_g', 'encoder.pos_conv_embed.conv.weight_v']

• This IS expected if you are initializing WavLMModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
• This IS NOT expected if you are initializing WavLMModel from the checkpoint of a model that you expect to be exactly identical (initializing a
  BertForSequenceClassification model from a BertForSequenceClassification model).
  Some weights of WavLMModel were not initialized from the model checkpoint at ./slm/wavlm-base-plus and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0']
  You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
  0%| | 0/348 [00:52<?, ?it/s]
  Traceback (most recent call last):
  File "D:\ai_bert_vits2\Bert-VITS2-Extra\train_ms.py", line 834, in
  run()
  File "D:\ai_bert_vits2\Bert-VITS2-Extra\train_ms.py", line 369, in run
  train_and_evaluate(
  File "D:\ai_bert_vits2\Bert-VITS2-Extra\train_ms.py", line 433, in train_and_evaluate
  for batch_idx, (
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\tqdm\std.py", line 1182, in iter
  for obj in iterable:
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\utils\data\dataloader.py", line 630, in next
  data = self._next_data()
  ^^^^^^^^^^^^^^^^^
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\utils\data\dataloader.py", line 1345, in _next_data
  return self._process_data(data)
  ^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\utils\data\dataloader.py", line 1371, in _process_data
  data.reraise()
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch_utils.py", line 694, in reraise
  raise exception
  FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0.
  Original Traceback (most recent call last):
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\utils\data_utils\worker.py", line 308, in _worker_loop
  data = fetcher.fetch(index)
  ^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\utils\data_utils\fetch.py", line 51, in fetch
  data = [self.dataset[idx] for idx in possibly_batched_index]
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\utils\data_utils\fetch.py", line 51, in
  data = [self.dataset[idx] for idx in possibly_batched_index]
  ~~~~~~~~~~~~^^^^^
  File "D:\ai_bert_vits2\Bert-VITS2-Extra\data_utils.py", line 177, in getitem
  return self.get_audio_text_speaker_pair(self.audiopaths_sid_text[index])
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\ai_bert_vits2\Bert-VITS2-Extra\data_utils.py", line 101, in get_audio_text_speaker_pair
  torch.load(audiopath.replace(".wav", ".emo.pt"), map_location="cpu"),
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\serialization.py", line 986, in load
  with _open_file_like(f, 'rb') as opened_file:
  ^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\serialization.py", line 435, in _open_file_like
  return _open_file(name_or_buffer, mode)
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\serialization.py", line 416, in init
  super().init(open(name, mode))
  ^^^^^^^^^^^^^^^^
  FileNotFoundError: [Errno 2] No such file or directory: './data/lili/wavs/矩形，长方形（又称rectangle）.emo.pt'

[2024-01-17 15:02:41,854] torch.distributed.elastic.multiprocessing.api: [ERROR] failed (exitcode: 1) local_rank: 0 (pid: 10468) of binary: C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\python.exe
Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Scripts\torchrun.exe_main.py", line 7, in
File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\distributed\elastic\multiprocessing\errors_init.py", line 346, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\distributed\run.py", line 806, in main
run(args)
File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\distributed\run.py", line 797, in run
elastic_launch(
File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\distributed\launcher\api.py", line 134, in call
return launch_agent(self._config, self._entrypoint, list(args))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\JustinZhang\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\distributed\launcher\api.py", line 264, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:

train_ms.py FAILED

Failures:
<NO_OTHER_FAILURES>

Root Cause (first observed failure):
[0]:
time : 2024-01-17_15:02:41
host : Justin
rank : 0 (local_rank: 0)
exitcode : 1 (pid: 10468)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html

[Stardust-minus]

首先你没带底模，其次你没跑clap_gen，请认真查看代码

[oszc]

感谢 ，确实忘记底模这件事了。
clip_gen这个版本需要手动跑吗？以前版本在webui_preprocess中执行所有步骤就不会报错了。

[Stardust-minus]

如果不存在emo.pt的话，一般是需要手动执行下clap_gen.py的