Machine Translation on FLORES Low Resource (Directional BLEU)
39.32BLEU (En->X)Seed-X-PPO-7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Seed-X-PPO-7B# Langs (Intersection)=27 (13/12/2)2025.11 | 39.32 | 42.53 | 21.84 | 33.86 | |
| LMT-60-8B# Langs (Intersection)=27 (13/12/2)2025.11 | 35.79 | 42.72 | 21.52 | 41.26 | |
| LMT-60-4B# Langs (Intersection)=27 (13/12/2)2025.11 | 35.02 | 42.7 | 20.64 | 41.25 | |
| Aya-expanse-8B# Langs (Intersection)=23 (13/9/1)2025.11 | 27.45 | 42.71 | 13.53 | 35.12 | |
| LMT-60-8B# Langs (Intersection)=23 (13/9/1)2025.11 | 27.15 | 44.58 | 14.53 | 41.76 | |
| LMT-60-4B# Langs (Intersection)=23 (13/9/1)2025.11 | 24.68 | 44.13 | 14.13 | 41.32 | |
| LMT-60-8B# Langs (Intersection)=28 (13/8/7)2025.11 | 22.28 | 39.51 | 13.6 | 38.42 | |
| X-ALMA-13B# Langs (Intersection)=40 (13/16/11)2025.11 | 22.16 | 35.74 | — | — | |
| GemmaX2-28-9B# Langs (Intersection)=28 (13/8/7)2025.11 | 22.06 | 43.09 | 13.74 | 38.21 | |
| LMT-60-8B# Langs (Intersection)=40 (13/16/11)2025.11 | 21.96 | 36.23 | — | — | |
| LMT-60-4B# Langs (Intersection)=28 (13/8/7)2025.11 | 21.51 | 38.61 | 13.01 | 37.71 | |
| LMT-60-4B# Langs (Intersection)=40 (13/16/11)2025.11 | 21.17 | 35.38 | — | — | |
| LMT-60-8B# Langs (Intersection)=55 (13/18/24)2025.11 | 21.11 | 37.01 | 12.82 | 37.8 | |
| LMT-60-8B# Langs (Intersection)=54 (13/18/23)2025.11 | 20.85 | 37.26 | 12.53 | 37.77 | |
| LMT-60-4B# Langs (Intersection)=55 (13/18/24)2025.11 | 20.38 | 36.01 | 12.27 | 37.1 | |
| LMT-60-4B# Langs (Intersection)=54 (13/18/23)2025.11 | 20.05 | 36.17 | 11.98 | 37.02 | |
| LMT-60-8B# Langs (Intersection)=59 (13/18/28)2025.11 | 19.75 | 35.81 | 12.21 | 37.47 | |
| NLLB-54B# Langs (Intersection)=59 (13/18/28)2025.11 | 19.2 | 37.06 | 10.79 | 25.04 | |
| LMT-60-8B# Langs (Intersection)=35 (13/9/13)2025.11 | 19.01 | 35.74 | 11.8 | 37.45 | |
| LMT-60-4B# Langs (Intersection)=59 (13/18/28)2025.11 | 18.93 | 34.77 | 11.56 | 36.79 | |
| LMT-60-4B# Langs (Intersection)=35 (13/9/13)2025.11 | 18 | 34.7 | 10.97 | 36.93 | |
| LLaMAX3-Alpaca# Langs (Intersection)=55 (13/18/24)2025.11 | 10.96 | 27.51 | 4.57 | 20.67 | |
| Hunyuan-MT-7B# Langs (Intersection)=35 (13/9/13)2025.11 | 9.99 | 21.81 | 6.59 | 22.04 | |
| Aya-101-13B# Langs (Intersection)=54 (13/18/23)2025.11 | 7.7 | 29.01 | 3.71 | 21.98 |