Machine Translation (ZH ⇄ XX) on FLORES-200 (2022)
0.8982XCOMET-XXLGemini 3.0 pro
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Gemini 3.0 procategory=ultra-large general model2025.12 | 0.8982 | 0.7882 | |
| DeepSeek-V3.2category=ultra-large general model, open-source=true2025.12 | 0.8752 | 0.7798 | |
| HY-MT1.5-7Bcategory=medium to small-sized general model, open-source=true, parameters=7B2025.12 | 0.869 | 0.7924 | |
| HY-MT1.0-7Bcategory=medium to small-sized general model, open-source=true, parameters=7B2025.12 | 0.8643 | 0.7913 | |
| Qwen3-235B-A22Bcategory=ultra-large general model, open-source=true, parameters=235B2025.12 | 0.8539 | 0.7651 | |
| Youdao-Translator (Lite)category=translation-specialized model, supported_languages_only=true2025.12 | 0.8474 | 0.772 | |
| HY-MT1.5-1.8Bcategory=medium to small-sized general model, open-source=true, parameters=1.8B2025.12 | 0.8361 | 0.7655 | |
| Microsoft-Translatorcategory=translation-specialized model2025.12 | 0.8234 | 0.7297 | |
| iFLYTEK-Translatorcategory=translation-specialized model2025.12 | 0.8196 | 0.7326 | |
| Qwen3-32Bcategory=medium to small-sized general model, open-source=true, parameters=32B2025.12 | 0.8185 | 0.7429 | |
| Doubao-Translatorcategory=translation-specialized model2025.12 | 0.8091 | 0.7156 | |
| Tower-Plus-72Bcategory=medium to small-sized general model, open-source=true, parameters=72B2025.12 | 0.7969 | 0.7182 | |
| Seed-X-PPO-7Bcategory=medium to small-sized general model, open-source=true, parameters=7B2025.12 | 0.7856 | 0.7145 | |
| Baidu-Translatorcategory=translation-specialized model2025.12 | 0.769 | 0.6789 | |
| GemmaX2-28-2B-v0.1category=medium to small-sized general model, open-source=true, parameters=2B2025.12 | 0.7142 | 0.6746 | |
| Google-Translatorcategory=translation-specialized model2025.12 | 0.6929 | 0.6169 | |
| Phi-4-mini-3.8Bcategory=medium to small-sized general model, open-source=true, parameters=3.8B2025.12 | 0.5839 | 0.4327 |