Machine Translation on Multi30k En-Cs 2016 (test)
0.414BLEUSMT-9B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SMT-9BInput Modality=Text, Speech, Speech Source=Synthetic2026.02 | 0.414 | 0.908 | — | |
| DeepSeek-V3.1Input Modality=Text2026.02 | 0.379 | 0.907 | — | |
| VGAMTObjectives=MMT + VMLM, Mode=Multimodal Machine Translation2022.12 | 0.376 | 0.934 | — | |
| mBART + MT* w/ adaptersObjectives=NMT + MLM, Mode=Text-only Machine Translation2022.12 | 0.373 | 0.94 | — | |
| Baseline + Lora (Text only)Input Modality=Text, Adaptation=LoRA2026.02 | 0.372 | 0.9 | — | |
| Soul-MixInput Modality=Text, Image, Image Source=Authentic2026.02 | 0.365 | — | — | |
| Gemma3-27B-itInput Modality=Text2026.02 | 0.364 | 0.899 | — | |
| NLLB-moe-54BInput Modality=Text2026.02 | 0.357 | 0.889 | — | |
| BridgeInput Modality=Text, Image, Image Source=Synthetic2026.02 | 0.352 | — | — | |
| ConsQA-MMTInput Modality=Text, Image, Image Source=Authentic2026.02 | 0.347 | — | — | |
| Baseline (Text only)Input Modality=Text2026.02 | 0.341 | 0.899 | — | |
| TLM + MT*Objectives=NMT, Mode=Text-only Machine Translation2022.12 | 0.326 | 0.642 | — | |
| mBART + MT*Mode=Text-only Machine Translation2022.12 | 0.321 | 0.865 | — | |
| VTLM + MMT*Objectives=MMT, Mode=Multimodal Machine Translation2022.12 | 0.32 | 0.621 | — | |
| Vanilla MT*Objectives=NMT, Mode=Text-only Machine Translation2022.12 | 0.313 | 0.593 | — | |
| Graph-MMT*Objectives=MMT, Mode=Multimodal Machine Translation2022.12 | 0.308 | 0.562 | — | |
| Gated Fusion*Objectives=MMT, Mode=Multimodal Machine Translation2022.12 | 0.308 | 0.56 | — | |
| Qwen3-Next-80B-A3BInput Modality=Text2026.02 | 0.292 | 0.872 | — | |
| Gated FusionModality=Multimodal2022.12 | — | — | 0.288 | |
| Graph-MMTModality=Multimodal2022.12 | — | — | 0.301 | |
| mBART + MTModality=Text-only, Adapters=false2022.12 | — | — | 0.307 | |
| mBART + MTModality=Text-only, Adapters=true2022.12 | — | — | 0.338 | |
| TLM + MTModality=Text-only2022.12 | — | — | 0.31 | |
| Vanilla MTModality=Text-only2022.12 | — | — | 0.305 | |
| VGAMTModality=Multimodal2022.12 | — | — | 0.337 | |
| VTLM + MMTModality=Multimodal2022.12 | — | — | 0.306 |