Text-Image Machine Translation on MMTIT-Bench other2zh 1.0 (test)
85Gemini-flash Judge ScoreGemini2.5-flash
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini2.5-flashParam.=-, Think=true2026.03 | 85 | 76.26 | 80.06 | |
| Qwen2.5-VLsft(CPR-Trans)Param.=7B, Think=true2026.03 | 82.84 | 82.23 | 81.04 | |
| Qwen3-VL-ThinkingParam.=235B-A22B, Think=true2026.03 | 77.9 | 72.14 | 78.81 | |
| dots.vlm1Param.=671B-A37B, Think=true2026.03 | 76.73 | 72.14 | 78.45 | |
| Seed1.6-ThinkingParam.=-, Think=true2026.03 | 75.82 | 73.9 | 78.77 | |
| Qwen3-VL-InstructParam.=235B-A22B, Think=false2026.03 | 69.67 | 65 | 77.2 | |
| MiMo-VLParam.=7B, Think=true2026.03 | 69.52 | 65.24 | 76.15 | |
| Seed1.6Param.=-, Think=false2026.03 | 66.35 | 65.45 | 76.55 | |
| Dots.ocr+Qwen3Param.=-, Think=false2026.03 | 65.27 | 60.98 | 73.42 | |
| Qwen2.5-VLsft(Direct)Param.=7B, Think=false2026.03 | 62.42 | 66.37 | 76.81 | |
| MinerU2.5+Qwen3Param.=-, Think=false2026.03 | 49.7 | 46.26 | 65.06 | |
| Qwen2.5-VL_OriginParam.=7B, Think=false2026.03 | 46.89 | 47.06 | 71.67 |