Machine Translation on WMT Ukrainian (test)
4.71BLEUMATT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MATTTraining Time=7h 00m2025.10 | 4.71 | 11.81 | |
| Gemma 3 12B PT2025.10 | 3.52 | 12.68 | |
| FOCUS w/ NTPTraining Time=10h 30m2025.10 | 2.6 | 8.46 | |
| FOCUS w/ NTPTraining Time=7h 00m2025.10 | 2.51 | 8.72 | |
| FOCUS w/ NTPTraining Time=3h 30m2025.10 | 2.13 | 7.56 | |
| Transtokenizers w/ NTPTraining Time=10h 30m2025.10 | 0.96 | 3.24 | |
| Transtokenizers w/ NTPTraining Time=7h 00m2025.10 | 0.95 | 3.14 | |
| FOCUS2025.10 | 0.88 | 2.07 | |
| Transtokenizers w/ NTPTraining Time=3h 30m2025.10 | 0.88 | 2.46 | |
| Token DistillationTraining Time=8h 20m2025.10 | 0.72 | 6.68 | |
| Token DistillationTraining Time=5h 30m2025.10 | 0.41 | 6.42 | |
| Transtokenizers2025.10 | 0.09 | 0.06 | |
| WECHSEL2025.10 | 0 | 0 | |
| TokAlign2025.10 | 0 | 0.08 |