List your company
ResearchFormerly WizWand

Machine Translation on WMT Ukrainian (test)

4.71BLEUMATT
-0.18841.08332.3553.6267Oct 24, 2025
Updated 5mo ago

Evaluation results

MethodLinks
MATTTraining Time=7h 00m2025.104.7111.81
Gemma 3 12B PT2025.103.5212.68
FOCUS w/ NTPTraining Time=10h 30m2025.102.68.46
FOCUS w/ NTPTraining Time=7h 00m2025.102.518.72
FOCUS w/ NTPTraining Time=3h 30m2025.102.137.56
Transtokenizers w/ NTPTraining Time=10h 30m2025.100.963.24
Transtokenizers w/ NTPTraining Time=7h 00m2025.100.953.14
FOCUS2025.100.882.07
Transtokenizers w/ NTPTraining Time=3h 30m2025.100.882.46
Token DistillationTraining Time=8h 20m2025.100.726.68
Token DistillationTraining Time=5h 30m2025.100.416.42
Transtokenizers2025.100.090.06
WECHSEL2025.1000
TokAlign2025.1000.08