Multilingual Translation on WMT22 (de, cs, zh, ru) and WMT21 (is) (test)
67.88COMET (de)Qwen2.5-VL 3B
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-VL 3BText Source=Pure-Text, LoRA setup=Same as SEETOK (†)2025.10 | 67.88 | 1.89 | 62.05 | 2.81 | 53.89 | 2.71 | 58.12 | 1.09 | 65.33 | 2.53 | 61.45 | 2.21 | |
| Qwen2.5-VL 3BText Source=Pure-Text, LoRA setup=Standard2025.10 | 67.25 | 1.89 | 62.02 | 2.81 | 53.63 | 2.71 | 57.51 | 1.09 | 63.16 | 2.53 | 60.71 | 2.21 | |
| SEETOKText Source=Visual-Text2025.10 | 65.63 | 0.42 | 64.89 | 0.38 | 54.97 | 0.37 | 68.94 | 0.21 | 71.42 | 0.49 | 65.17 | 0.37 | |
| Qwen2.5-VL 3BText Source=Visual-Text2025.10 | 47.49 | 0.42 | 41.02 | 0.38 | 34.37 | 0.37 | 46.77 | 0.21 | 46.44 | 0.49 | 33.72 | 0.37 |