Machine Translation on Mandarin ⇔ Minority (General)
62.44XCOMET-XXL ScoreHy-MT2-30B-A3B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Hy-MT2-30B-A3B2026.05 | 62.44 | 42.37 | 69.43 | |
| Hy-MT2-7B2026.05 | 62.05 | 43.6 | 68.93 | |
| HY-MT1.5-7B2026.05 | 61.74 | 44.55 | 67.26 | |
| Gemini 3.1 ProThinking Mode=true2026.05 | 61.11 | 53.5 | 79.7 | |
| GPT-5.5Thinking Mode=true2026.05 | 60.87 | 55.18 | 79.68 | |
| GPT-5.5Thinking Mode=false2026.05 | 59.81 | 53.32 | 75.16 | |
| iFLYTEK-Translator2026.05 | 59.04 | 44.67 | — | |
| Hy-MT2-1.8B2026.05 | 58.29 | 39.22 | 62.36 | |
| HY-MT1.5-1.8B2026.05 | 58.06 | 40.84 | 61.66 | |
| GLM5.1Thinking Mode=true2026.05 | 57.51 | 54.46 | 71.72 | |
| DeepSeek-V4-ProThinking Mode=true2026.05 | 56.31 | 51.24 | 69.48 | |
| GLM5.1Thinking Mode=false2026.05 | 56 | 50.68 | 67.7 | |
| Kimi K2.6Thinking Mode=true2026.05 | 55.98 | 54.76 | 68.73 | |
| Qwen3.5-397B-A17BThinking Mode=true2026.05 | 55.97 | 51.89 | 70.21 | |
| DeepSeek-V4-ProThinking Mode=false2026.05 | 55.61 | 51.47 | 66.02 | |
| Qwen3.5-397B-A17BThinking Mode=false2026.05 | 55.59 | 54.44 | 67.45 | |
| Kimi K2.6Thinking Mode=false2026.05 | 54.29 | 52.52 | 64 | |
| Qwen3.6-35B-A3BThinking Mode=true2026.05 | 54.07 | 53.37 | 64.44 | |
| Doubao-Translator2026.05 | 53.11 | 40.16 | 66.81 | |
| Qwen3.6-35B-A3BThinking Mode=false2026.05 | 52.12 | 51.74 | 58.28 | |
| Gemma4-31BThinking Mode=true2026.05 | 51.99 | 51.49 | 64.17 | |
| Microsoft-Translator2026.05 | 51.8 | 41.77 | 55.27 | |
| Gemma4-31BThinking Mode=false2026.05 | 48.98 | 50.05 | 56.75 | |
| Gemma4-26B-A4BThinking Mode=true2026.05 | 47.83 | 49.19 | 56.73 | |
| Gemma4-26B-A4BThinking Mode=false2026.05 | 44.52 | 46.14 | 47.7 | |
| Gemma4-E4BThinking Mode=false2026.05 | 41.17 | 40.23 | 43.19 | |
| Gemma4-E4BThinking Mode=true2026.05 | 41.16 | 40.64 | 42.25 | |
| Gemma4-E2BThinking Mode=true2026.05 | 40.44 | 40.39 | 42.67 | |
| Gemma4-E2BThinking Mode=false2026.05 | 39.07 | 33.83 | 34.62 | |
| Tower-Plus-72B2026.05 | 38.55 | 35.4 | 26.7 |