Machine Translation on FLORES-200 (ET→EN)
41.2BLEUEuroLLM-9B
Evaluation results
| Method | Links | |
|---|---|---|
| EuroLLM-9Bsetting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 41.2 | |
| Apertus-8B-2509setting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 38.5 | |
| Apertus-EstLLM-8B-1125setting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 37.4 | |
| Llama-3.1-EstLLM-8B-0525setting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 36.8 | |
| Llama-3.1-8Bsetting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 33.7 | |
| Llammas-basesetting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 32.7 | |
| Ministral-3-8B-Base-2512setting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 29.6 | |
| Qwen2.5-7Bsetting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 27.5 | |
| salamandra-7bsetting=zero-shot, decoding=deterministic, evaluation=generative2026.03 | 18.2 |