Machine Translation on Multi30k En→Fr v1 2017 (test)
56BLEUVALHALLA (M)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VALHALLA (M)Translation Setting=Multimodal, Ground-truth Visual Tokens usage=true, Model Averaging=true2022.05 | 56 | 77.1 | |
| VALHALLATranslation Setting=Text-Only, Ground-truth Visual Tokens usage=false, Model Averaging=true2022.05 | 56 | 77.1 | |
| VALHALLATranslation Setting=Text-Only, Ground-truth Visual Tokens usage=false, Model Averaging=false2022.05 | 55.1 | 76.4 | |
| VALHALLA (M)Translation Setting=Multimodal, Ground-truth Visual Tokens usage=true, Model Averaging=false2022.05 | 55 | 76.4 | |
| Gated Fusion#Params=2.8M, Backbone=Transformer-Tiny2021.05 | 54.85 | — | |
| Gated FusionTranslation Setting=Multimodal2022.05 | 54.8 | 76.3 | |
| RMMTTranslation Setting=Text-Only2022.05 | 54.4 | 76.1 | |
| RMMT#Params=2.9M, Backbone=Transformer-Tiny2021.05 | 54.39 | — | |
| DCCN#Params=16.9M2021.05 | 54.3 | — | |
| DCCNTranslation Setting=Multimodal2022.05 | 54.3 | 70.3 | |
| Imagination#Params=6.9M, Backbone=Transformer-Tiny2021.05 | 54.07 | — | |
| GMNMT2021.05 | 53.9 | — | |
| GMNMTTranslation Setting=Multimodal2022.05 | 53.9 | 69.3 | |
| Transformer-Small#Params=36.4M2021.05 | 53.85 | — | |
| Doubly-ATT#Params=3.2M, Backbone=Transformer-Tiny2021.05 | 53.72 | — | |
| Transformer-Tiny#Params=2.6M2021.05 | 53.46 | — | |
| UVR-NMT#Params=2.9M, Backbone=Transformer-Tiny2021.05 | 53.2 | — | |
| Transformer-Base#Params=49.0M2021.05 | 53.16 | — | |
| CAP-ALLTranslation Setting=Multimodal2022.05 | 52.8 | 68.6 | |
| ImagiTTranslation Setting=Text-Only2022.05 | 52.4 | 68.3 | |
| Ours#testing_mode=image input given, input=paired images2023.05 | 50.4 | 42.5 | |
| UVR-NMTTranslation Setting=Text-Only2022.05 | 48.7 | — | |
| w/o SGstesting_mode=image input given, ablation=without Scene Graphs2023.05 | 46.2 | 40.7 | |
| PVPtesting_mode=image input given2023.05 | 46 | 39.8 | |
| Ourstesting_mode=without image input given, visual_hallucination=SG-based2023.05 | 45.5 | 37.3 | |
| UMMTtesting_mode=image input given2023.05 | 40.5 | 37.2 | |
| PVP*testing_mode=without image input given, visual_hallucination=phrase-level retrieval-based2023.05 | 39 | 31.9 | |
| UMMT*testing_mode=without image input given, visual_hallucination=phrase-level retrieval-based2023.05 | 31.8 | 30.4 | |
| PVPtesting_mode=without image input given2023.05 | 25.7 | 23.4 | |
| UMMTtesting_mode=without image input given2023.05 | 10.2 | 13.6 | |
| Gated FusionModality=Multimodal2022.12 | — | 67.1 | |
| Graph-MMTModality=Multimodal2022.12 | — | 68.7 | |
| mBART + MTModality=Text-only, Adapters=false2022.12 | — | 66.8 | |
| mBART + MTModality=Text-only, Adapters=true2022.12 | — | 76 | |
| TLM + MTModality=Text-only2022.12 | — | 70.3 | |
| Vanilla MTModality=Text-only2022.12 | — | 68.3 | |
| VGAMTModality=Multimodal2022.12 | — | 75.9 | |
| VTLM + MMTModality=Multimodal2022.12 | — | 69.8 |