Machine Translation on FLORES-200 ZH ⇔ XX
90.3XCOMET-XXLGemini 3.1 Pro
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 3.1 ProThinking Mode=true2026.05 | 90.3 | 78.96 | 92.14 | |
| GPT-5.5Thinking Mode=true2026.05 | 89.94 | 78.95 | 91.98 | |
| Hy-MT2-30B-A3B2026.05 | 89.83 | 79.03 | 90.26 | |
| GPT-5.5Thinking Mode=false2026.05 | 89.6 | 78.96 | 91.65 | |
| Hy-MT2-7B2026.05 | 89.45 | 78.97 | 88.89 | |
| Gemma4-31BThinking Mode=true2026.05 | 89.3 | 78.86 | 91.16 | |
| DeepSeek-V4-ProThinking Mode=true2026.05 | 88.86 | 78.13 | 90.97 | |
| GLM5.1Thinking Mode=true2026.05 | 88.78 | 78.28 | 91.38 | |
| Gemma4-26B-A4BThinking Mode=true2026.05 | 88.68 | 78.68 | 90.74 | |
| DeepSeek-V4-ProThinking Mode=false2026.05 | 88.6 | 78.11 | 90.15 | |
| Qwen3.5-397B-A17BThinking Mode=false2026.05 | 88.5 | 78.64 | 90.66 | |
| Kimi K2.6Thinking Mode=true2026.05 | 88.49 | 77.97 | 90.84 | |
| Gemma4-31BThinking Mode=false2026.05 | 88.4 | 78.68 | 89.89 | |
| Qwen3.5-397B-A17BThinking Mode=true2026.05 | 87.79 | 77.75 | 90.58 | |
| Qwen3.6-35B-A3BThinking Mode=true2026.05 | 87.71 | 77.93 | 90.32 | |
| Kimi K2.6Thinking Mode=false2026.05 | 87.68 | 77.55 | 89.85 | |
| Gemma4-26B-A4BThinking Mode=false2026.05 | 87.61 | 78.31 | 88.97 | |
| GLM5.1Thinking Mode=false2026.05 | 87.09 | 77.6 | 89.44 | |
| HY-MT1.5-7B2026.05 | 86.9 | 79.24 | 84.35 | |
| Qwen3.6-35B-A3BThinking Mode=false2026.05 | 86.32 | 78 | 87.34 | |
| Hy-MT2-1.8B2026.05 | 84.26 | 76.43 | 82.71 | |
| HY-MT1.5-1.8B2026.05 | 83.61 | 76.55 | 76.79 | |
| Gemma4-E4BThinking Mode=true2026.05 | 83.49 | 75.94 | 83.96 | |
| Gemma4-E4BThinking Mode=false2026.05 | 83.36 | 75.92 | 83.52 | |
| Gemma4-E2BThinking Mode=true2026.05 | 83.21 | 76.18 | 84.21 | |
| iFLYTEK-Translator2026.05 | 83 | 73.96 | — | |
| Microsoft-Translator2026.05 | 82.95 | 72.85 | 84.79 | |
| Doubao-Translator2026.05 | 80.92 | 71.57 | 82.14 | |
| Gemma4-E2BThinking Mode=false2026.05 | 79.78 | 73.19 | 76.46 | |
| Tower-Plus-72B2026.05 | 79.69 | 71.82 | 77.86 |