Machine Translation on FLORES (Directional Scores)
89.07Average ScoreSeed-X-PPO-7B
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Seed-X-PPO-7B#Langs=272025.11 | 89.07 | — | — | — | — | — | 90.78 | 89.05 | 88.48 | 87.96 | |
| LMT-60-8B#Langs=402025.11 | 89.06 | — | — | — | — | — | 89.38 | 88.73 | — | — | |
| LMT-60-4B#Langs=402025.11 | 88.96 | — | — | — | — | — | 89.24 | 88.67 | — | — | |
| LMT-60-8B#Langs=272025.11 | 88.94 | — | — | — | — | — | 90.49 | 88.88 | 88.23 | 88.16 | |
| X-ALMA-13B#Langs=402025.11 | 88.92 | — | — | — | — | — | 89.17 | 88.68 | — | — | |
| LMT-60-4B#Langs=272025.11 | 88.86 | — | — | — | — | — | 90.35 | 88.87 | 88.02 | 88.19 | |
| LMT-60-8B#Langs=102025.11 | 88.43 | — | — | — | — | — | 89.42 | 88.59 | 87.3 | 88.4 | |
| LMT-60-8B#Langs=232025.11 | 88.36 | — | — | — | — | — | 89.63 | 88.65 | 87.18 | 87.98 | |
| LMT-60-4B#Langs=102025.11 | 88.34 | — | — | — | — | — | 89.29 | 88.58 | 87.09 | 88.4 | |
| LMT-60-4B#Langs=232025.11 | 88.26 | — | — | — | — | — | 89.44 | 88.62 | 87 | 87.99 | |
| LMT-60-8B#Langs=282025.11 | 87.83 | — | — | — | — | — | 88.83 | 88.62 | 86.12 | 87.76 | |
| LMT-60-4B#Langs=282025.11 | 87.73 | — | — | — | — | — | 88.72 | 88.52 | 85.97 | 87.71 | |
| TowerInstruct-13B#Langs=102025.11 | 87.63 | — | — | — | — | — | 88.91 | 88.51 | 86.29 | 86.81 | |
| LMT-60-8B#Langs=352025.11 | 87.63 | — | — | — | — | — | 88.84 | 88.12 | 86.18 | 87.36 | |
| GemmaX2-28-9B#Langs=282025.11 | 87.57 | — | — | — | — | — | 88.39 | 88.95 | 85.56 | 87.37 | |
| LMT-60-8B#Langs=552025.11 | 87.56 | — | — | — | — | — | 88.78 | 88.32 | 85.91 | 87.23 | |
| LMT-60-8B#Langs=592025.11 | 87.56 | — | — | — | — | — | 88.91 | 88.07 | 86.16 | 87.11 | |
| LMT-60-8B#Langs=542025.11 | 87.55 | — | — | — | — | — | 88.75 | 88.36 | 85.84 | 87.24 | |
| LMT-60-4B#Langs=352025.11 | 87.5 | — | — | — | — | — | 88.72 | 88 | 86.03 | — | |
| LMT-60-4B#Langs=552025.11 | 87.44 | — | — | — | — | — | 88.66 | 88.2 | 85.74 | 87.16 | |
| LMT-60-4B#Langs=592025.11 | 87.43 | — | — | — | — | — | 88.78 | 87.93 | 86 | 87 | |
| LMT-60-4B#Langs=542025.11 | 87.42 | — | — | — | — | — | 88.61 | 88.23 | 85.67 | 87.15 | |
| Aya-expanse-8B#Langs=232025.11 | 87.36 | — | — | — | — | — | 88.66 | 88.31 | 86.26 | 86.2 | |
| Hunyuan-MT-7B#Langs=352025.11 | 85.71 | — | — | — | — | — | 86.78 | 86.42 | 83.88 | 85.74 | |
| NLLB-54B#Langs=592025.11 | 84.79 | — | — | — | — | — | 86.89 | 87.72 | 84.06 | 80.5 | |
| Aya-101-13B#Langs=542025.11 | 83.85 | — | — | — | — | — | 84.87 | 86.45 | 81.53 | 82.54 | |
| LLaMAX3-Alpaca#Langs=552025.11 | 81.45 | — | — | — | — | — | 81.29 | 86.27 | 77.24 | 81.02 | |
| HybridBackbone=Wizard-Vicuna-30B, Shots=322025.12 | 32.8 | 28.7 | 36.9 | 8.2 | — | — | — | — | — | — | |
| LoRA-GABackbone=Wizard-Vicuna-30B, Shots=322025.12 | 32.2 | 28.1 | 36.4 | 8.3 | — | — | — | — | — | — | |
| BOFTBackbone=Wizard-Vicuna-30B, Shots=322025.12 | 32 | 27.9 | 36.2 | 8.3 | — | — | — | — | — | — | |
| LoRABackbone=Wizard-Vicuna-30B, Shots=322025.12 | 31.6 | 27.4 | 35.8 | 8.4 | — | — | — | — | — | — | |
| HybridBackbone=BloomZ-7B1, Shots=322025.12 | 29.8 | 25.9 | 33.6 | 7.7 | — | — | — | — | — | — | |
| LoRA-GABackbone=BloomZ-7B1, Shots=322025.12 | 29.2 | 25.3 | 33 | 7.7 | — | — | — | — | — | — | |
| BOFTBackbone=BloomZ-7B1, Shots=322025.12 | 29 | 25.1 | 32.8 | 7.7 | — | — | — | — | — | — | |
| LoRABackbone=BloomZ-7B1, Shots=322025.12 | 28.5 | 24.6 | 32.3 | 7.7 | — | — | — | — | — | — | |
| EuroLLM-9B-InstructParams (B)=9.2, Trained on FLORES=true2026.04 | 20.61 | — | — | — | 19.28 | 21.95 | — | — | — | — | |
| Bielik-11B-v3.0-InstructParams (B)=11.22026.04 | 19.22 | — | — | — | 18.54 | 19.91 | — | — | — | — | |
| Bielik-11B-v3-Base-20250730Params (B)=11.22026.04 | 17.85 | — | — | — | 17.6 | 18.11 | — | — | — | — | |
| Bielik-PL-11B-v3.0-InstructParams (B)=11.22026.04 | 17.82 | — | — | — | 17.58 | 18.07 | — | — | — | — | |
| phi-4Params (B)=14.72026.04 | 15.58 | — | — | — | 14.55 | 16.61 | — | — | — | — | |
| Bielik-Minitron-7B-v3.0-InstructParams (B)=7.52026.04 | 15.53 | — | — | — | 15.74 | 15.32 | — | — | — | — | |
| Bielik-PL-Minitron-7B-v3.0-InstructParams (B)=7.52026.04 | 15.15 | — | — | — | 15.99 | 14.31 | — | — | — | — | |
| Mistral-Nemo-Instruct-2407Params (B)=12.22026.04 | 14.35 | — | — | — | 13.37 | 15.33 | — | — | — | — | |
| Bielik-11B-v2.6-InstructParams (B)=11.22026.04 | 13.58 | — | — | — | 15.77 | 11.38 | — | — | — | — | |
| Qwen2.5-14B-InstructParams (B)=14.82026.04 | 13.24 | — | — | — | 12.55 | 13.93 | — | — | — | — | |
| Qwen2.5-7B-InstructParams (B)=7.62026.04 | 11.34 | — | — | — | 10.43 | 12.26 | — | — | — | — | |
| Bielik-11B-v2Params (B)=11.22026.04 | 11.25 | — | — | — | 14.86 | 7.64 | — | — | — | — |