Machine Translation on FLORES-200 XX ⇔ XX (2022)
87.73XCOMET-XXLGemini 3.0 pro
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini 3.0 pro2025.12 | 87.73 | 75.3 | |
| DeepSeek-V3.2open-source=true2025.12 | 84.21 | 75.21 | |
| HY-MT1.5-7Bopen-source=true, parameters=7B2025.12 | 80.98 | 73.36 | |
| Qwen3-235B-A22Bopen-source=true, parameters=235B2025.12 | 80.18 | 73.13 | |
| Microsoft-Translator2025.12 | 80.07 | 72.53 | |
| Youdao-Translator (Lite)supported_languages_only=true2025.12 | 78.4 | 75.99 | |
| HY-MT1.5-1.8Bopen-source=true, parameters=1.8B2025.12 | 78.4 | 71.82 | |
| HY-MT1.0-7Bopen-source=true, parameters=7B2025.12 | 78.29 | 72.1 | |
| Doubao-Translator2025.12 | 76.53 | 69.93 | |
| iFLYTEK-Translator2025.12 | 74.67 | 68.68 | |
| Qwen3-32Bopen-source=true, parameters=32B2025.12 | 74.33 | 69.65 | |
| Tower-Plus-72Bopen-source=true, parameters=72B2025.12 | 70.02 | 65.53 | |
| Seed-X-PPO-7Bopen-source=true, parameters=7B2025.12 | 68.96 | 64.36 | |
| Baidu-Translator2025.12 | 68.07 | 63.69 | |
| GemmaX2-28-2B-v0.1open-source=true, parameters=2B2025.12 | 63.76 | 63.1 | |
| Google-Translator2025.12 | 62.25 | 59.47 | |
| Phi-4-mini-3.8Bopen-source=true, parameters=3.8B2025.12 | 46.06 | 34.82 |