Machine Translation on WMT24++ v1.0 (test)
90XCOMET ScoreMiLMMT-46-12B
Evaluation Results
| Method | Links | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MiLMMT-46-12BLanguage Coverage=26 languages2026.02 | 90 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.89 | |
| MiLMMT-46-12BLanguage Coverage=21 languages2026.02 | 89.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.58 | |
| MiLMMT-46-4BLanguage Coverage=26 languages2026.02 | 88.43 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 81.98 | |
| MiLMMT-46-4BLanguage Coverage=21 languages2026.02 | 88.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 81.6 | |
| Tower-Plus-9BLanguage Coverage=21 languages2026.02 | 88.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 81.74 | |
| Seed-X-PPO-7BLanguage Coverage=26 languages2026.02 | 87.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.91 | |
| MiLMMT-46-12BLanguage Coverage=28 languages2026.02 | 86.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.45 | |
| MiLMMT-46-12BLanguage Coverage=46 languages2026.02 | 86.68 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.87 | |
| Seed-X-Instruct-7BLanguage Coverage=26 languages2026.02 | 86.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 79.1 | |
| Gemini 3 ProLanguage Coverage=46 languages2026.02 | 86.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.85 | |
| Gemini 3 Proshots=82026.02 | 86.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.85 | |
| GPT-5Language Coverage=46 languages2026.02 | 86.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.27 | |
| GPT-5shots=82026.02 | 86.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.27 | |
| MiLMMT-46-12BLanguage Coverage=31 languages2026.02 | 86.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.47 | |
| Gemini 2.5 ProLanguage Coverage=46 languages2026.02 | 85.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.59 | |
| Gemini 2.5 Proshots=82026.02 | 85.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.59 | |
| Hunyuan-MT-7BLanguage Coverage=31 languages2026.02 | 85.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 81.85 | |
| HY-MT1.5-7BLanguage Coverage=31 languages2026.02 | 85.77 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.01 | |
| TranslateGemma-12BLanguage Coverage=46 languages2026.02 | 85.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.78 | |
| HY-MT1.5-1.8BLanguage Coverage=31 languages2026.02 | 85.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 78.21 | |
| MiLMMT-46-4BLanguage Coverage=28 languages2026.02 | 85.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.62 | |
| MiLMMT-46-4BLanguage Coverage=46 languages2026.02 | 84.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.91 | |
| Google TranslateLanguage Coverage=46 languages2026.02 | 84.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 81.48 | |
| Google Translatetype=Supervised NMT2026.02 | 84.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 81.48 | |
| MiLMMT-46-4BLanguage Coverage=31 languages2026.02 | 84.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.59 | |
| Tower-Plus-2BLanguage Coverage=21 languages2026.02 | 83.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.93 | |
| MiLMMT-46-1BLanguage Coverage=21 languages2026.02 | 82.22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.69 | |
| GemmaX2-28-9BLanguage Coverage=28 languages2026.02 | 80.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.21 | |
| Gemma3-12Bshots=8, parameters=12B2026.02 | 79.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.17 | |
| GemmaX2-28-2BLanguage Coverage=28 languages2026.02 | 78.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.61 | |
| MiLMMT-46-1BLanguage Coverage=28 languages2026.02 | 78.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.76 | |
| MiLMMT-46-1BLanguage Coverage=31 languages2026.02 | 77.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.75 | |
| MiLMMT-46-1BLanguage Coverage=46 languages2026.02 | 77.37 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.51 | |
| TranslateGemma-4BLanguage Coverage=46 languages2026.02 | 76.62 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.49 | |
| Gemma2-9Bshots=8, parameters=9B2026.02 | 73.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.85 | |
| Gemma3-4Bshots=8, parameters=4B2026.02 | 72.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.36 | |
| Qwen3-14Bshots=8, parameters=14B2026.02 | 71.16 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.05 | |
| Qwen3-8Bshots=8, parameters=8B2026.02 | 66.46 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.25 | |
| Qwen2.5-14Bshots=8, parameters=14B2026.02 | 62 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55.76 | |
| Qwen3-4Bshots=8, parameters=4B2026.02 | 58.64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 51.99 | |
| Gemma2-2Bshots=8, parameters=2B2026.02 | 57.14 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 48.71 | |
| Qwen2.5-7Bshots=8, parameters=7B2026.02 | 52.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 44.84 | |
| Gemma3-1Bshots=8, parameters=1B2026.02 | 52.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 44 | |
| Qwen3-1.7Bshots=8, parameters=1.7B2026.02 | 45.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 35.81 | |
| Qwen2.5-3Bshots=8, parameters=3B2026.02 | 43.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 33.67 | |
| Qwen2.5-1.5Bshots=8, parameters=1.5B2026.02 | 36.16 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 25.08 | |
| Qwen3-0.6Bshots=8, parameters=0.6B2026.02 | 31.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 18.65 | |
| Gemma3-270Mshots=8, parameters=270M2026.02 | 27.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 11.28 | |
| Qwen2.5-0.5Bshots=8, parameters=0.5B2026.02 | 26.14 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 10.9 | |
| Gemini 2.5 Pro2026.02 | — | 86.67 | 82.28 | 80.04 | 82.84 | 88.51 | 82.45 | 84 | 80.83 | 85.51 | 77.87 | 87.11 | 80.97 | 93.05 | 84.82 | 95.04 | 81.36 | 87.59 | 82.12 | 90.74 | 80.42 | 85.98 | 84.15 | 91.54 | 88.82 | 86.94 | 79.8 | 84.2 | 79.51 | 81.02 | 72.8 | 88.86 | 84.01 | 89.99 | 86.76 | 91.11 | 84.51 | 88.29 | 80.34 | 88.15 | 88.42 | 76.55 | 86.57 | 76.73 | 84.86 | 90.45 | 86.39 | 77.28 | 81.84 | 88.14 | 81.18 | 75.03 | 84.59 | 93.18 | 86.29 | 93.39 | 84.41 | 88.93 | 81.05 | 90.58 | 81.61 | 88.06 | 86.15 | 87.32 | 81.65 | 87.8 | 82.78 | 86.94 | 82.19 | 93.55 | 86.22 | 77.98 | 81.24 | 88.83 | 83.87 | 81.35 | 79.84 | 83.82 | 82.14 | 82.47 | 80.93 | 68.56 | 81.69 | 89.08 | 84.72 | 75.67 | 75.11 | 86.12 | 81.48 | 85.98 | 82.64 | — | |
| Gemini 3 Pro2026.02 | — | 86.87 | 82.38 | 81.37 | 83.34 | 88.61 | 82.8 | 86.38 | 82.4 | 86.37 | 78.52 | 87.34 | 81.3 | 93.31 | 85.34 | 94.95 | 81.79 | 87.23 | 81.98 | 90.92 | 80.62 | 86.75 | 84.41 | 91.72 | 88.65 | 86.83 | 79.61 | 84.83 | 80.16 | 82.53 | 73.97 | 89.11 | 84.46 | 90.26 | 86.46 | 91.13 | 84.34 | 88.92 | 80.5 | 88.47 | 88.91 | 77.11 | 85.38 | 78.84 | 85.43 | 91.1 | 87.34 | 78.79 | 82.33 | 87.88 | 80.78 | 75.95 | 84.69 | 93.52 | 87.01 | 93.35 | 84.66 | 89.07 | 81.39 | 90.46 | 81.7 | 88.62 | 87.08 | 87.53 | 81.55 | 87.36 | 82.5 | 87.17 | 81.95 | 93.66 | 86.54 | 81.14 | 82.48 | 90.19 | 84.41 | 82.03 | 78.93 | 83.38 | 81.98 | 83.62 | 81.55 | 69.54 | 82.17 | 89.56 | 84.69 | 75.44 | 74.83 | 86.88 | 81.77 | 87.12 | 83.09 | — | |
| Google Translate2026.02 | — | 88.21 | 83.22 | 76.17 | 78.85 | 86.62 | 80.88 | 78.58 | 77.48 | 84.27 | 76.68 | 84.78 | 78.66 | 91.96 | 82.74 | 95.52 | 82.29 | 85.5 | 79.75 | 90.66 | 80.15 | 84.76 | 83.34 | 89.4 | 86.18 | 89.3 | 81.81 | 82.31 | 77.12 | 85.75 | 75.08 | 87.31 | 83.15 | 87.8 | 84.72 | 91.94 | 85.58 | 89.14 | 81.26 | 88.69 | 89.02 | 74.23 | 84.28 | 75.16 | 82.9 | 92.39 | 88.43 | 75.44 | 78.97 | 84.32 | 76.94 | 72.57 | 82.03 | 91.57 | 84.62 | 94.82 | 86.56 | 88.92 | 81.2 | 92.33 | 83.98 | 86.53 | 84.41 | 89.14 | 84.06 | 85.41 | 80.43 | 85.27 | 80.45 | 91.73 | 84.15 | 70.71 | 76.42 | 92 | 86.42 | 79.55 | 78.29 | 86.85 | 85.13 | 65.49 | 68.34 | 65.51 | 79.28 | 91.18 | 87.01 | 67.23 | 67.43 | 88.14 | 83.21 | 87.81 | 83.85 | — | |
| GPT-52026.02 | — | 86.12 | 82.82 | 81.81 | 83.45 | 88.65 | 83.51 | 84.1 | 81.21 | 86.8 | 79.51 | 87.34 | 82.61 | 93.22 | 85.85 | 94.98 | 82.23 | 87.79 | 82.54 | 91.32 | 81.53 | 86.61 | 84.78 | 91.17 | 89.41 | 87.18 | 80.66 | 84.88 | 80.47 | 82.53 | 73.31 | 89.31 | 84.76 | 90.73 | 87.4 | 91.4 | 84.48 | 89.32 | 81.69 | 89.09 | 89.45 | 77.23 | 86.3 | 76.47 | 84.22 | 90.66 | 87.52 | 75.06 | 79.91 | 88.33 | 81.46 | 74.71 | 84.5 | 93.56 | 87.15 | 93.61 | 85.52 | 89.47 | 82.44 | 90.99 | 82.85 | 89.47 | 87.66 | 87.61 | 82.37 | 87.18 | 83.77 | 87.78 | 82.78 | 93.76 | 87.17 | 76.65 | 80.38 | 89.51 | 84.72 | 81.39 | 81.17 | 83.73 | 82.56 | 82.77 | 81.15 | 69.76 | 81.94 | 89.26 | 84.78 | 79.25 | 78.76 | 86.91 | 81.8 | 86.76 | 82.78 | — | |
| MiLMMT-12BParameters=12B2026.02 | — | 85.46 | 81.45 | 81.81 | 82.34 | 88.77 | 82.92 | 85.05 | 81.91 | 87.32 | 79.32 | 87.45 | 81.27 | 93.44 | 84.5 | 95.28 | 81.97 | 87.54 | 82.05 | 91.25 | 81.35 | 85.7 | 84.17 | 90.41 | 86.93 | 87.86 | 80.95 | 84.73 | 79.63 | 79.97 | 73.22 | 89.36 | 83.91 | 89.53 | 86.14 | 91.41 | 83.62 | 90.16 | 81.84 | 89.61 | 89.16 | 78.05 | 86.58 | 79.28 | 84.79 | 90.9 | 87.45 | 79.98 | 81.75 | 88.83 | 81.23 | 77.8 | 85.57 | 93.66 | 86.14 | 94.01 | 84.44 | 89.72 | 81.63 | 92.11 | 83.55 | 89.33 | 86.88 | 87.26 | 82.5 | 87.74 | 82.06 | 87.43 | 81.31 | 93.64 | 86.33 | 77.26 | 81.34 | 88.78 | 84.5 | 82.41 | 78.32 | 84.5 | 82.38 | 81.06 | 80.32 | 72.36 | 82.36 | 89.49 | 84.96 | 80.18 | 78.71 | 86.43 | 82.1 | 86.25 | 83.17 | — | |
| MiLMMT-1BParameters=1B2026.02 | — | 75.74 | 71.49 | 66.63 | 70.13 | 79.62 | 72.77 | 75.19 | 73.43 | 80.61 | 70.71 | 75.03 | 66.77 | 88.23 | 76.92 | 91.24 | 73.63 | 77.26 | 70.48 | 87.25 | 75.11 | 72 | 70.13 | 76.44 | 72.79 | 81.71 | 73.56 | 73.22 | 66.46 | 68.51 | 66.01 | 79.88 | 73.34 | 76.67 | 72 | 86.47 | 78.17 | 84.64 | 74.01 | 80.69 | 83.07 | 63.41 | 76.71 | 69.21 | 77.25 | 82.53 | 80.25 | 68 | 72.8 | 84.87 | 76.63 | 60.5 | 74.46 | 88.35 | 79.4 | 88.88 | 77.05 | 78.3 | 68.03 | 88.25 | 77.74 | 80.2 | 76.06 | 78.67 | 70.94 | 75.11 | 67.99 | 75.61 | 68.01 | 88.47 | 78.35 | 61.64 | 68.91 | 79.05 | 75.87 | 74.69 | 70.4 | 73.06 | 72 | 67.77 | 70.38 | 58.61 | 73.72 | 84.95 | 79.95 | 74.26 | 72 | 80.77 | 75.9 | 79.58 | 76.26 | — | |
| MiLMMT-4BParameters=4B2026.02 | — | 84.01 | 79.54 | 79.17 | 80.36 | 86.76 | 80.2 | 83.2 | 80.33 | 86.36 | 78.08 | 84.25 | 77.73 | 92.23 | 82.89 | 94.56 | 80.38 | 86.3 | 79.53 | 90.55 | 80.06 | 82.6 | 81.03 | 87.86 | 84.32 | 86.53 | 78.96 | 82.72 | 77.2 | 78.13 | 71.73 | 87.59 | 82.12 | 87.07 | 83.22 | 90.38 | 82.69 | 89.6 | 80.48 | 87.55 | 87.72 | 75.41 | 84.8 | 77.28 | 83.4 | 89.03 | 85.62 | 78.62 | 80.82 | 87.92 | 80.25 | 74.55 | 83.6 | 92.7 | 85.04 | 92.85 | 82.96 | 87.3 | 78.63 | 90.82 | 82.24 | 88.33 | 84.61 | 85.62 | 79.63 | 84.87 | 78.45 | 84.83 | 78.67 | 92.58 | 84.51 | 74.51 | 78.93 | 87.21 | 82.66 | 81.27 | 77.11 | 81.57 | 79.96 | 78.3 | 78.69 | 69.39 | 80.55 | 87.88 | 83.17 | 78.19 | 76.94 | 84.87 | 80.1 | 84.68 | 81.23 | — |