Machine Translation on FLORES High Resource (BLEU Directions)
38.34En->X BLEULMT-60-8B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LMT-60-8B# Langs (Intersection)=10 (9/1/0)2025.11 | 38.34 | 39.28 | 24.25 | 42.09 | |
| Seed-X-PPO-7B# Langs (Intersection)=27 (13/12/2)2025.11 | 37.88 | 37.14 | 23.13 | 34.03 | |
| TowerInstruct-13B# Langs (Intersection)=10 (9/1/0)2025.11 | 37.46 | 39.55 | 21.56 | 36.72 | |
| LMT-60-4B# Langs (Intersection)=10 (9/1/0)2025.11 | 37.35 | 39.15 | 23.03 | 41.93 | |
| GemmaX2-28-9B# Langs (Intersection)=28 (13/8/7)2025.11 | 36.23 | 39.78 | 22.6 | 40.42 | |
| X-ALMA-13B# Langs (Intersection)=40 (13/16/11)2025.11 | 35.76 | 38.22 | — | — | |
| LMT-60-8B# Langs (Intersection)=23 (13/9/1)2025.11 | 35 | 38.16 | 22.48 | 41.33 | |
| LMT-60-8B# Langs (Intersection)=27 (13/12/2)2025.11 | 35 | 38.16 | 22.48 | 41.33 | |
| LMT-60-8B# Langs (Intersection)=28 (13/8/7)2025.11 | 35 | 38.16 | 22.48 | 41.33 | |
| LMT-60-8B# Langs (Intersection)=35 (13/9/13)2025.11 | 35 | 38.16 | 22.48 | 41.33 | |
| LMT-60-8B# Langs (Intersection)=40 (13/16/11)2025.11 | 35 | 38.16 | — | — | |
| LMT-60-8B# Langs (Intersection)=54 (13/18/23)2025.11 | 35 | 38.16 | 22.48 | 41.33 | |
| LMT-60-8B# Langs (Intersection)=55 (13/18/24)2025.11 | 35 | 38.16 | 22.48 | 41.33 | |
| LMT-60-8B# Langs (Intersection)=59 (13/18/28)2025.11 | 35 | 38.16 | 22.48 | 41.33 | |
| LMT-60-4B# Langs (Intersection)=23 (13/9/1)2025.11 | 33.79 | 37.97 | 21.42 | 41.1 | |
| LMT-60-4B# Langs (Intersection)=27 (13/12/2)2025.11 | 33.79 | 37.97 | 21.42 | 41.1 | |
| LMT-60-4B# Langs (Intersection)=28 (13/8/7)2025.11 | 33.79 | 37.97 | 21.42 | 41.1 | |
| LMT-60-4B# Langs (Intersection)=35 (13/9/13)2025.11 | 33.79 | 37.97 | 21.42 | 41.1 | |
| LMT-60-4B# Langs (Intersection)=40 (13/16/11)2025.11 | 33.79 | 37.97 | — | — | |
| LMT-60-4B# Langs (Intersection)=54 (13/18/23)2025.11 | 33.79 | 37.97 | 21.42 | 41.1 | |
| LMT-60-4B# Langs (Intersection)=55 (13/18/24)2025.11 | 33.79 | 37.97 | 21.42 | 41.1 | |
| LMT-60-4B# Langs (Intersection)=59 (13/18/28)2025.11 | 33.79 | 37.97 | 21.42 | 41.1 | |
| NLLB-54B# Langs (Intersection)=59 (13/18/28)2025.11 | 33.02 | 39.15 | 20.81 | 24.51 | |
| Aya-expanse-8B# Langs (Intersection)=23 (13/9/1)2025.11 | 31.74 | 36.64 | 19.7 | 34.58 | |
| Hunyuan-MT-7B# Langs (Intersection)=35 (13/9/13)2025.11 | 27.72 | 28.65 | 17.55 | 28.49 | |
| LLaMAX3-Alpaca# Langs (Intersection)=55 (13/18/24)2025.11 | 24.51 | 32.28 | 12.94 | 26.18 | |
| Aya-101-13B# Langs (Intersection)=54 (13/18/23)2025.11 | 22.75 | 30.67 | 12.86 | 24.1 |