Machine Translation on Mandarin ⇔ Minority (test)
0.6174XCOMET-XXLHY-MT1.5-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HY-MT1.5-7Bopen-source=true, parameters=7B2025.12 | 0.6174 | 0.4455 | |
| HY-MT1.0-7Bopen-source=true, parameters=7B2025.12 | 0.6082 | 0.4162 | |
| Gemini 3.0 pro2025.12 | 0.5921 | 0.5274 | |
| HY-MT1.5-1.8Bopen-source=true, parameters=1.8B2025.12 | 0.5806 | 0.4084 | |
| Doubao-Translatorsupported_languages_only=true2025.12 | 0.5314 | 0.4061 | |
| Microsoft-Translator2025.12 | 0.5196 | 0.3218 | |
| DeepSeek-V3.2open-source=true2025.12 | 0.5133 | 0.5253 | |
| iFLYTEK-Translator2025.12 | 0.5011 | 0.4871 | |
| Youdao-Translator (Lite)supported_languages_only=true2025.12 | 0.4525 | 0.505 | |
| Qwen3-235B-A22Bopen-source=true, parameters=235B2025.12 | 0.4493 | 0.4456 | |
| Seed-X-PPO-7Bopen-source=true, parameters=7B2025.12 | 0.4206 | 0.4861 | |
| Qwen3-32Bopen-source=true, parameters=32B2025.12 | 0.411 | 0.3841 | |
| Tower-Plus-72Bopen-source=true, parameters=72B2025.12 | 0.3855 | 0.354 | |
| GemmaX2-28-2B-v0.1open-source=true, parameters=2B2025.12 | 0.3596 | 0.3981 | |
| Phi-4-mini-3.8Bopen-source=true, parameters=3.8B2025.12 | 0.3542 | 0.2003 | |
| Google-Translator2025.12 | 0.3338 | 0.3209 |