Multimodal Abstractive Summarization on MM-Sum mid-high-resource (test)
41.59ROUGE-1SOV-MAS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SOV-MASTraining Manner=Multilingual Training, Language=Chinese2022.12 | 41.59 | 26.52 | 34.53 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Chinese2022.12 | 40.59 | 25.32 | 33.36 | |
| mT5Training Manner=Multilingual Training, Language=Chinese2022.12 | 40.3 | 24.97 | 33.04 | |
| mT5Training Manner=Monolingual Training, Language=Chinese2022.12 | 40.2 | 25.39 | 33.49 | |
| VG-mT5Training Manner=Multilingual Training, Language=Chinese2022.12 | 40.14 | 25.29 | 33.31 | |
| VG-mT5Training Manner=Monolingual Training, Language=Chinese2022.12 | 39.99 | 25.19 | 33.19 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Urdu2022.12 | 39.38 | 18.38 | 32.76 | |
| mT5Training Manner=Monolingual Training, Language=Urdu2022.12 | 38.22 | 17.25 | 31.37 | |
| mT5Training Manner=Multilingual Training, Language=Urdu2022.12 | 38.15 | 17.12 | 31.36 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Urdu2022.12 | 38.1 | 16.98 | 31.18 | |
| VG-mT5Training Manner=Monolingual Training, Language=Urdu2022.12 | 38.07 | 17.31 | 31.54 | |
| VG-mT5Training Manner=Multilingual Training, Language=Urdu2022.12 | 38.04 | 17.32 | 31.67 | |
| SOV-MASTraining Manner=Multilingual Training, Language=English2022.12 | 37.86 | 15.23 | 29.89 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Persian2022.12 | 37.69 | 16.9 | 30.71 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Indonesian2022.12 | 37.5 | 17.33 | 31.22 | |
| SOV-MASTraining Manner=Monolingual Training, Language=English2022.12 | 37.26 | 15.02 | 29.61 | |
| VG-mT5Training Manner=Monolingual Training, Language=English2022.12 | 37.17 | 14.88 | 29.41 | |
| mT5Training Manner=Monolingual Training, Language=English2022.12 | 36.99 | 15.18 | 29.64 | |
| VG-mT5Training Manner=Multilingual Training, Language=Persian2022.12 | 36.71 | 16.19 | 29.8 | |
| mT5Training Manner=Multilingual Training, Language=English2022.12 | 36.65 | 13.91 | 28.53 | |
| VG-mT5Training Manner=Multilingual Training, Language=English2022.12 | 36.62 | 14.13 | 28.76 | |
| VG-mT5Training Manner=Multilingual Training, Language=Indonesian2022.12 | 36.5 | 16.31 | 30.13 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Persian2022.12 | 36.44 | 15.92 | 29.5 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Hindi2022.12 | 36.42 | 14.95 | 29.77 | |
| mT5Training Manner=Multilingual Training, Language=Persian2022.12 | 36.39 | 15.84 | 29.45 | |
| mT5Training Manner=Monolingual Training, Language=Persian2022.12 | 36.14 | 15.55 | 29.25 | |
| VG-mT5Training Manner=Monolingual Training, Language=Persian2022.12 | 36.12 | 15.59 | 29.15 | |
| mT5Training Manner=Multilingual Training, Language=Indonesian2022.12 | 35.84 | 15.66 | 29.4 | |
| mT5Training Manner=Multilingual Training, Language=Hindi2022.12 | 35.5 | 13.91 | 28.52 | |
| VG-mT5Training Manner=Monolingual Training, Language=Indonesian2022.12 | 35.47 | 15.47 | 29.12 | |
| VG-mT5Training Manner=Multilingual Training, Language=Hindi2022.12 | 35.36 | 14.16 | 28.87 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Indonesian2022.12 | 35.17 | 15.35 | 28.85 | |
| mT5Training Manner=Monolingual Training, Language=Indonesian2022.12 | 35.1 | 15.44 | 28.91 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Hindi2022.12 | 34.83 | 13.6 | 28.25 | |
| VG-mT5Training Manner=Monolingual Training, Language=Hindi2022.12 | 34.82 | 13.94 | 28.59 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Vietnamese2022.12 | 34.78 | 17.85 | 27.17 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Arabic2022.12 | 34.74 | 14.48 | 28.84 | |
| mT5Training Manner=Multilingual Training, Language=Arabic2022.12 | 34.34 | 14.3 | 28.43 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Avg.2022.12 | 34.04 | 15.36 | 27.83 | |
| VG-mT5Training Manner=Monolingual Training, Language=Arabic2022.12 | 33.88 | 14.2 | 28 | |
| VG-mT5Training Manner=Multilingual Training, Language=Vietnamese2022.12 | 33.78 | 17.06 | 26.32 | |
| mT5Training Manner=Multilingual Training, Language=Vietnamese2022.12 | 33.71 | 16.72 | 25.97 | |
| mT5Training Manner=Monolingual Training, Language=Arabic2022.12 | 33.67 | 14.06 | 27.83 | |
| mT5Training Manner=Monolingual Training, Language=Hindi2022.12 | 33.66 | 13.14 | 27.71 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Arabic2022.12 | 33.63 | 13.83 | 27.64 | |
| VG-mT5Training Manner=Multilingual Training, Language=Arabic2022.12 | 33.42 | 13.58 | 27.62 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Turkish2022.12 | 32.94 | 15.77 | 29.01 | |
| mT5Training Manner=Multilingual Training, Language=Avg.2022.12 | 32.88 | 14.3 | 26.61 | |
| VG-mT5Training Manner=Multilingual Training, Language=Avg.2022.12 | 32.84 | 14.49 | 26.82 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Avg.2022.12 | 32.49 | 14.26 | 26.4 | |
| VG-mT5Training Manner=Monolingual Training, Language=Avg.2022.12 | 32.34 | 14.24 | 26.39 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Portuguese2022.12 | 32.32 | 11.9 | 23.83 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Vietnamese2022.12 | 32.22 | 15.99 | 24.95 | |
| mT5Training Manner=Monolingual Training, Language=Vietnamese2022.12 | 32.18 | 15.84 | 24.83 | |
| VG-mT5Training Manner=Monolingual Training, Language=Vietnamese2022.12 | 32.18 | 15.98 | 24.84 | |
| mT5Training Manner=Monolingual Training, Language=Avg.2022.12 | 32.14 | 14.16 | 26.26 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Russian2022.12 | 31.96 | 13.3 | 25.69 | |
| mT5Training Manner=Multilingual Training, Language=Turkish2022.12 | 31.93 | 14.69 | 27.76 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Russian2022.12 | 31.86 | 13.38 | 25.45 | |
| VG-mT5Training Manner=Multilingual Training, Language=Turkish2022.12 | 31.44 | 14.73 | 27.71 | |
| VG-mT5Training Manner=Monolingual Training, Language=Russian2022.12 | 31.38 | 13.02 | 25.22 | |
| VG-mT5Training Manner=Multilingual Training, Language=Portuguese2022.12 | 31.22 | 11.43 | 23.24 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Spanish2022.12 | 31.2 | 11.64 | 23.73 | |
| mT5Training Manner=Multilingual Training, Language=Russian2022.12 | 31.12 | 12.33 | 24.67 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Turkish2022.12 | 31.02 | 14.64 | 27.2 | |
| mT5Training Manner=Multilingual Training, Language=Portuguese2022.12 | 30.84 | 10.92 | 22.64 | |
| VG-mT5Training Manner=Multilingual Training, Language=Spanish2022.12 | 30.57 | 10.96 | 23.21 | |
| VG-mT5Training Manner=Monolingual Training, Language=Turkish2022.12 | 30.51 | 14.41 | 26.76 | |
| VG-mT5Training Manner=Multilingual Training, Language=Russian2022.12 | 30.42 | 12.29 | 24.38 | |
| mT5Training Manner=Monolingual Training, Language=Turkish2022.12 | 30.37 | 14.39 | 26.79 | |
| mT5Training Manner=Monolingual Training, Language=Portuguese2022.12 | 30.13 | 10.32 | 22.06 | |
| mT5Training Manner=Monolingual Training, Language=Russian2022.12 | 30.01 | 12.47 | 24.28 | |
| mT5Training Manner=Multilingual Training, Language=Spanish2022.12 | 29.91 | 10.7 | 22.66 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Portuguese2022.12 | 29.83 | 10.05 | 21.78 | |
| VG-mT5Training Manner=Monolingual Training, Language=Portuguese2022.12 | 29.69 | 9.82 | 22.1 | |
| mT5Training Manner=Monolingual Training, Language=Spanish2022.12 | 29.51 | 10.48 | 22.51 | |
| VG-mT5Training Manner=Monolingual Training, Language=Spanish2022.12 | 29.5 | 10.62 | 22.47 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Spanish2022.12 | 29.27 | 10.4 | 22.43 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Tamil2022.12 | 24.22 | 10.79 | 21.92 | |
| SOV-MASTraining Manner=Multilingual Training, Language=Ukrainian2022.12 | 23.91 | 9.97 | 20.53 | |
| VG-mT5Training Manner=Multilingual Training, Language=Tamil2022.12 | 23.04 | 10.25 | 20.94 | |
| mT5Training Manner=Multilingual Training, Language=Tamil2022.12 | 22.96 | 10.05 | 20.75 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Tamil2022.12 | 22.82 | 10.55 | 20.67 | |
| mT5Training Manner=Multilingual Training, Language=Ukrainian2022.12 | 22.79 | 9.13 | 19.46 | |
| VG-mT5Training Manner=Multilingual Training, Language=Ukrainian2022.12 | 22.6 | 9.27 | 19.55 | |
| mT5Training Manner=Monolingual Training, Language=Tamil2022.12 | 22.31 | 10.08 | 20.36 | |
| VG-mT5Training Manner=Monolingual Training, Language=Tamil2022.12 | 22.3 | 10.15 | 20.39 | |
| SOV-MASTraining Manner=Monolingual Training, Language=Ukrainian2022.12 | 21.84 | 8.62 | 18.69 | |
| VG-mT5Training Manner=Monolingual Training, Language=Ukrainian2022.12 | 21.71 | 8.89 | 18.79 | |
| mT5Training Manner=Monolingual Training, Language=Ukrainian2022.12 | 21.57 | 8.66 | 18.64 |