推理速度慢

[lihaibineric]

在用Teval评测的过程中，这里用的是SFT之后的模型，为什么推理的速度这么慢，需要修改什么参数来优化吗 这里的bsz = 1
0%| | 0/11 [00:00<?, ?it/s]
15:02:21.737 9%|▉ | 1/11 [13:11<2:11:59, 791.93s/it]
15:15:35.421 18%|█▊ | 2/11 [33:02<2:33:56, 1026.32s/it]
15:24:54.511 27%|██▋ | 3/11 [46:16<2:02:40, 920.09s/it]
15:34:16.527 36%|███▋ | 4/11 [55:35<1:30:43, 777.57s/it]
16:05:55.790 45%|████▌ | 5/11 [1:04:57<1:09:59, 699.84s/it]
16:18:26.938 55%|█████▍ | 6/11 [1:36:36<1:32:18, 1107.65s/it]
16:27:02.793 64%|██████▎ | 7/11 [1:49:07<1:06:04, 991.10s/it]
16:45:40.823 73%|███████▎ | 8/11 [1:57:43<41:59, 839.80s/it]