Machine Translation on BOUQuET En-YY
63.6ChrF++ (high)GPT-OSS 120B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-OSS 120BModel Size=120B2026.03 | 63.6 | 43.7 | 26 | 16 | 13.4 | 30.8 | |
| NLLB-2002026.03 | 62.9 | 46.8 | 24.6 | 17.5 | 13.2 | 31.3 | |
| Gemma 32026.03 | 62.6 | 40.9 | 24 | 14.8 | 11.6 | 28.9 | |
| MADLAD2026.03 | 62.2 | 35.5 | 21.5 | 15.3 | 11.5 | 26.6 | |
| OMT-NLLBBase Model=NLLB2026.03 | 61.1 | 47.6 | 27.3 | 17.5 | 11.5 | 31.9 | |
| OMT-LLaMA 8BModel Size=8B, Base Model=LLaMA2026.03 | 60.7 | 45.8 | 30.8 | 18.8 | 12.6 | 32.8 | |
| LLaMA 3 70BModel Size=70B2026.03 | 60.2 | 37.2 | 23.7 | 16.2 | 14.3 | 28.2 | |
| TranslateGemma2026.03 | 59.5 | 42 | 22.1 | 15.5 | 12.4 | 28.5 | |
| OMT-LLaMA 3BModel Size=3B, Base Model=LLaMA2026.03 | 59.4 | 45 | 28.7 | 16.8 | 11.3 | 31.3 | |
| GPT-OSS 20BModel Size=20B2026.03 | 59.2 | 36.7 | 20.2 | 13.1 | 12.1 | 26.1 | |
| Tower+2026.03 | 58.9 | 26.9 | 15.2 | 11.3 | 10.3 | 21.3 | |
| Tiny Aya Global2026.03 | 58.5 | 29.5 | 13.3 | 9 | 10.3 | 21 | |
| OMT-LLaMA 1BModel Size=1B, Base Model=LLaMA2026.03 | 56.5 | 42.2 | 25.1 | 14.9 | 12.3 | 29.1 | |
| Aya-1012026.03 | 52.8 | 33.7 | 16.6 | 11.4 | 10.9 | 23.1 | |
| LLaMA 3 8BModel Size=8B2026.03 | 52.7 | 26 | 13.1 | 9.5 | 8.2 | 19.1 | |
| Hunyuan-MT2026.03 | 47.8 | 21.5 | 13.9 | 12.4 | 10.8 | 18.5 |