Machine Translation on Multi30k En-Cs 2018 (test)
39.9BLEUSMT-9B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SMT-9BInput Modality=Text, Speech, Speech Source=Synthetic2026.02 | 39.9 | 0.898 | — | |
| DeepSeek-V3.1Input Modality=Text2026.02 | 35.9 | 0.897 | — | |
| Gemma3-27B-itInput Modality=Text2026.02 | 35.9 | 0.891 | — | |
| NLLB-moe-54BInput Modality=Text2026.02 | 35.8 | 0.883 | — | |
| Baseline + Lora (Text only)Input Modality=Text, Adaptation=LoRA2026.02 | 35.7 | 0.891 | — | |
| mBART + MT* w/ adaptersObjectives=NMT + MLM, Mode=Text-only Machine Translation2022.12 | 35.2 | 0.876 | — | |
| Baseline (Text only)Input Modality=Text2026.02 | 34.8 | 0.89 | — | |
| VGAMTObjectives=MMT + VMLM, Mode=Multimodal Machine Translation2022.12 | 34.2 | 0.833 | — | |
| Soul-MixInput Modality=Text, Image, Image Source=Authentic2026.02 | 32.8 | — | — | |
| BridgeInput Modality=Text, Image, Image Source=Synthetic2026.02 | 31.2 | — | — | |
| ConsQA-MMTInput Modality=Text, Image, Image Source=Authentic2026.02 | 30.3 | — | — | |
| mBART + MT*Mode=Text-only Machine Translation2022.12 | 29.6 | 0.747 | — | |
| Qwen3-Next-80B-A3BInput Modality=Text2026.02 | 27.9 | 0.859 | — | |
| TLM + MT*Objectives=NMT, Mode=Text-only Machine Translation2022.12 | 26.8 | 0.432 | — | |
| VTLM + MMT*Objectives=MMT, Mode=Multimodal Machine Translation2022.12 | 26.7 | 0.419 | — | |
| Vanilla MT*Objectives=NMT, Mode=Text-only Machine Translation2022.12 | 26 | 0.379 | — | |
| Gated Fusion*Objectives=MMT, Mode=Multimodal Machine Translation2022.12 | 25.8 | 0.342 | — | |
| Graph-MMT*Objectives=MMT, Mode=Multimodal Machine Translation2022.12 | 24.9 | 0.344 | — | |
| Gated FusionModality=Multimodal2022.12 | — | — | 25.1 | |
| Graph-MMTModality=Multimodal2022.12 | — | — | 26 | |
| mBART + MTModality=Text-only, Adapters=false2022.12 | — | — | 28.1 | |
| mBART + MTModality=Text-only, Adapters=true2022.12 | — | — | 31.4 | |
| TLM + MTModality=Text-only2022.12 | — | — | 26.6 | |
| Vanilla MTModality=Text-only2022.12 | — | — | 26.5 | |
| VGAMTModality=Multimodal2022.12 | — | — | 30.5 | |
| VTLM + MMTModality=Multimodal2022.12 | — | — | 26.4 |