Reading Comprehension on Belebele Ukrainian (test)
89.56AccuracyMATT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MATTTraining Time=7h 00m2025.10 | 89.56 | 77.27 | |
| Gemma 3 12B PT2025.10 | 89.33 | 78.18 | |
| FOCUS w/ NTPTraining Time=10h 30m2025.10 | 87.44 | 74.01 | |
| FOCUS w/ NTPTraining Time=7h 00m2025.10 | 87 | 73.78 | |
| Transtokenizers w/ NTPTraining Time=10h 30m2025.10 | 85.67 | 72.53 | |
| FOCUS w/ NTPTraining Time=3h 30m2025.10 | 85.44 | 71.41 | |
| Transtokenizers w/ NTPTraining Time=7h 00m2025.10 | 85.22 | 72.53 | |
| Token DistillationTraining Time=8h 20m2025.10 | 82.89 | 71.06 | |
| Transtokenizers w/ NTPTraining Time=3h 30m2025.10 | 82.44 | 70.73 | |
| Token DistillationTraining Time=5h 30m2025.10 | 82 | 70.05 | |
| Transtokenizers2025.10 | 61.89 | 53.96 | |
| FOCUS2025.10 | 48.78 | 42.96 | |
| TokAlign2025.10 | 31.44 | 32.21 | |
| WECHSEL2025.10 | 22.67 | 23.64 |