Machine Translation on WMT document-level 24++ (Resource Groupings)
32.45High Resource MT Score (En->X)LMT-60-8B
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LMT-60-8B# Langs (Hig./Med./Low)=10 (9/1/0)2025.11 | 32.45 | 34.24 | 19.88 | 29.31 | 25.28 | 21.57 | 22.41 | 24.05 | — | — | — | — | — | |
| TowerInstruct-13B# Langs (Hig./Med./Low)=10 (9/1/0)2025.11 | 32.33 | 35.15 | 15.54 | 25.74 | 16.07 | 16.92 | 10.81 | 15.26 | — | — | — | — | — | |
| LMT-60-4B# Langs (Hig./Med./Low)=10 (9/1/0)2025.11 | 28.89 | 28.59 | 17.41 | 34.83 | 15.39 | 17.1 | 18.43 | 30.19 | — | — | — | — | — | |
| Aya-expanse-8B# Langs (Hig./Med./Low)=23 (13/9/1)2025.11 | 28.46 | 32.2 | 17.15 | 31.3 | 27.15 | 31.95 | 16.36 | 30.07 | 24.48 | 34.64 | 13.12 | 29.58 | — | |
| LMT-60-8B# Langs (Hig./Med./Low)=23 (13/9/1)2025.11 | 28.18 | 29.74 | 17.48 | 28.18 | 26.58 | 21.72 | 17.17 | 26.58 | 15.78 | 35.22 | 8.12 | 29.73 | — | |
| LMT-60-8B# Langs (Hig./Med./Low)=24 (13/8/3)2025.11 | 28.18 | 29.74 | 17.48 | 28.18 | 20.92 | 18.76 | 14.53 | 26.57 | 20.81 | 27.36 | 12.06 | 29.42 | — | |
| LMT-60-8B# Langs (Hig./Med./Low)=28 (13/9/6)2025.11 | 28.18 | 29.74 | 17.48 | 28.18 | 21.4 | 18.74 | 14.56 | 26.3 | 16.29 | 18.54 | 9.33 | 23.59 | — | |
| LMT-60-8B# Langs (Hig./Med./Low)=33 (13/16/4)2025.11 | 28.18 | 29.74 | — | — | 28.1 | 26.45 | — | — | 17 | 22.03 | — | — | — | |
| LMT-60-8B# Langs (Hig./Med./Low)=39 (13/18/8)2025.11 | 28.18 | 29.74 | 17.48 | 28.18 | 26.78 | 25.62 | 15.91 | 26.68 | 17.19 | 19.33 | 9.87 | 22.59 | — | |
| LMT-60-4B# Langs (Hig./Med./Low)=23 (13/9/1)2025.11 | 25 | 26.4 | 15.46 | 33.16 | 19.33 | 24.47 | 14.12 | 27.48 | 15.28 | 30.02 | 8.12 | 30.96 | — | |
| LMT-60-4B# Langs (Hig./Med./Low)=24 (13/8/3)2025.11 | 25 | 26.4 | 15.46 | 33.16 | 15.27 | 21.77 | 12.03 | 25.79 | 20.41 | 25.37 | 11.43 | 27.58 | — | |
| LMT-60-4B# Langs (Hig./Med./Low)=28 (13/9/6)2025.11 | 25 | 26.4 | 15.46 | 33.16 | 15.72 | 22.22 | 11.96 | 25.81 | 14.13 | 20.09 | 7.8 | 21.27 | — | |
| LMT-60-4B# Langs (Hig./Med./Low)=33 (13/16/4)2025.11 | 25 | 26.4 | — | — | 21.24 | 26.08 | — | — | 14.84 | 23.11 | — | — | — | |
| LMT-60-4B# Langs (Hig./Med./Low)=39 (13/18/8)2025.11 | 25 | 26.4 | 15.46 | 33.16 | 20.08 | 25.17 | 13.41 | 28.36 | 15.73 | 19.76 | 8.9 | 22.39 | — | |
| Hunyuan-MT-7B# Langs (Hig./Med./Low)=28 (13/9/6)2025.11 | 19.28 | 26.6 | 14.4 | 28.44 | 14.66 | 23.38 | 11.12 | 25.21 | 7.47 | 22.09 | 5.51 | 20.84 | — | |
| GemmaX2-28-9B# Langs (Hig./Med./Low)=24 (13/8/3)2025.11 | 16.84 | 22.03 | 10.56 | 21.98 | 12.39 | 13.6 | 8.06 | 16.88 | 12.6 | 9.6 | 7.19 | 19.33 | — | |
| X-ALMA-13B# Langs (Hig./Med./Low)=33 (13/16/4)2025.11 | 11.98 | 12.58 | — | — | 11.99 | 11.55 | — | — | 6.72 | 9.07 | — | — | — | |
| Aya-101-13B# Langs (Hig./Med./Low)=39 (13/18/8)2025.11 | 10.26 | 15.01 | 5.91 | 7.53 | 11.39 | 15.75 | 5.11 | 8.96 | 6.63 | 15.39 | 2.4 | 8.61 | — | |
| Aya-101-13BLangs Dist (Hig./Med./Low)=39 (13/18/8)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 77.68 | |
| Aya-expanse-8BLangs Dist (Hig./Med./Low)=23 (13/9/1)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.03 | |
| GemmaX2-28-9BLangs Dist (Hig./Med./Low)=24 (13/8/3)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 76.42 | |
| Hunyuan-MT-7BLangs Dist (Hig./Med./Low)=28 (13/9/6)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.32 | |
| LMT-60-4BLangs Dist (Hig./Med./Low)=10 (9/1/0)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.37 | |
| LMT-60-4BLangs Dist (Hig./Med./Low)=23 (13/9/1)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 82.93 | |
| LMT-60-4BLangs Dist (Hig./Med./Low)=24 (13/8/3)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 82.93 | |
| LMT-60-4BLangs Dist (Hig./Med./Low)=28 (13/9/6)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 82.93 | |
| LMT-60-4BLangs Dist (Hig./Med./Low)=33 (13/16/4)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 82.93 | |
| LMT-60-4BLangs Dist (Hig./Med./Low)=39 (13/18/8)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 82.93 | |
| LMT-60-8BLangs Dist (Hig./Med./Low)=10 (9/1/0)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.54 | |
| LMT-60-8BLangs Dist (Hig./Med./Low)=23 (13/9/1)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.15 | |
| LMT-60-8BLangs Dist (Hig./Med./Low)=24 (13/8/3)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.15 | |
| LMT-60-8BLangs Dist (Hig./Med./Low)=28 (13/9/6)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.15 | |
| LMT-60-8BLangs Dist (Hig./Med./Low)=33 (13/16/4)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.15 | |
| LMT-60-8BLangs Dist (Hig./Med./Low)=39 (13/18/8)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.15 | |
| TowerInstruct-13BLangs Dist (Hig./Med./Low)=10 (9/1/0)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 83.33 | |
| X-ALMA-13BLangs Dist (Hig./Med./Low)=33 (13/16/4)2025.11 | — | — | — | — | — | — | — | — | — | — | — | — | 79.31 |