feat: token prediction (speculative decoding) #760
Job | Run time |
---|---|
1m 28s | |
1m 51s | |
50m 16s | |
33m 59s | |
3m 29s | |
36m 45s | |
3m 46s | |
0s | |
1m 7s | |
0s | |
0s | |
0s | |
0s | |
0s | |
2h 12m 41s |
Job | Run time |
---|---|
1m 28s | |
1m 51s | |
50m 16s | |
33m 59s | |
3m 29s | |
36m 45s | |
3m 46s | |
0s | |
1m 7s | |
0s | |
0s | |
0s | |
0s | |
0s | |
2h 12m 41s |