Machine Translation on Multi30K En → De (test)
57.2METEOROurs#
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ours#testing_mode=image input given, input=paired images2023.05 | 57.2 | 37.4 | |
| w/o SGstesting_mode=image input given, ablation=without Scene Graphs2023.05 | 56.4 | 34.5 | |
| PVPtesting_mode=image input given2023.05 | 54.1 | 33.9 | |
| mBART + MTModality=Text-only, Adapters=true2022.12 | 53.9 | — | |
| VGAMTModality=Multimodal2022.12 | 53.6 | — | |
| Ourstesting_mode=without image input given, visual_hallucination=SG-based2023.05 | 52.3 | 32 | |
| mBART + MTModality=Text-only, Adapters=false2022.12 | 48.3 | — | |
| TLM + MTModality=Text-only2022.12 | 48.1 | — | |
| VTLM + MMTModality=Multimodal2022.12 | 47.7 | — | |
| Vanilla MTModality=Text-only2022.12 | 46.9 | — | |
| Gated FusionModality=Multimodal2022.12 | 46.2 | — | |
| Graph-MMTModality=Multimodal2022.12 | 45.7 | — | |
| PVP*testing_mode=without image input given, visual_hallucination=phrase-level retrieval-based2023.05 | 40.1 | 25.4 | |
| Ours#testing_mode=image input given, input=paired images2023.05 | 38.3 | 39.2 | |
| w/o SGstesting_mode=image input given, ablation=without Scene Graphs2023.05 | 35.2 | 36.9 | |
| PVPtesting_mode=image input given2023.05 | 34.7 | 36.1 | |
| Ourstesting_mode=without image input given, visual_hallucination=SG-based2023.05 | 32.8 | 33.6 | |
| UMMTtesting_mode=image input given2023.05 | 29.7 | 26.4 | |
| UMMTtesting_mode=image input given2023.05 | 26.1 | 23.5 | |
| PVP*testing_mode=without image input given, visual_hallucination=phrase-level retrieval-based2023.05 | 26 | 27.6 | |
| UMMT*testing_mode=without image input given, visual_hallucination=phrase-level retrieval-based2023.05 | 22.7 | 19.3 | |
| UMMT*testing_mode=without image input given, visual_hallucination=phrase-level retrieval-based2023.05 | 17.7 | 15.7 | |
| PVPtesting_mode=without image input given2023.05 | 17.2 | 14 | |
| PVPtesting_mode=without image input given2023.05 | 13.8 | 11.1 | |
| UMMTtesting_mode=without image input given2023.05 | 11.3 | 8.4 | |
| UMMTtesting_mode=without image input given2023.05 | 10.8 | 7.5 | |
| Game-MMTtesting_mode=image input given2023.05 | — | 16.6 | |
| Game-MMTtesting_mode=image input given2023.05 | — | 19.6 |