Fixing tokenizer not stripping "Ideographic Full Stop" (chinese full … #1551
| Job | Run time |
|---|---|
| 2m 31s | |
| 4m 0s | |
| 2m 29s | |
| 4m 7s | |
| 2m 36s | |
| 4m 27s | |
| 2m 30s | |
| 2m 34s | |
| 2m 23s | |
| 3m 6s | |
| 2m 43s | |
| 33m 26s |
| Job | Run time |
|---|---|
| 2m 31s | |
| 4m 0s | |
| 2m 29s | |
| 4m 7s | |
| 2m 36s | |
| 4m 27s | |
| 2m 30s | |
| 2m 34s | |
| 2m 23s | |
| 3m 6s | |
| 2m 43s | |
| 33m 26s |