Translation on FLoRes+ En-YY (high resource level)
58.6ChrF++Gemma 3
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma 32026.03 | 58.6 | |
| GPT-OSS 120BParameters=120B2026.03 | 58.2 | |
| OMT-NLLB2026.03 | 57.6 | |
| OMT-LLaMA 8BParameters=8B2026.03 | 57.4 | |
| NLLB-2002026.03 | 57.2 | |
| MADLAD2026.03 | 57.2 | |
| LLaMA 3 70BParameters=70B2026.03 | 56.7 | |
| EuroLLM2026.03 | 55.7 | |
| TranslateGemma2026.03 | 55.4 | |
| GPT-OSS 20BParameters=20B2026.03 | 54.8 | |
| Tower+2026.03 | 54.5 | |
| Tiny Aya Global2026.03 | 53.6 | |
| LLaMA 3 8BParameters=8B2026.03 | 51.4 | |
| Aya-1012026.03 | 48.5 | |
| Aya Expanse2026.03 | 48 | |
| Hunyuan-MT2026.03 | 45.6 |