Multimodal Summarization on MM-Sum low-resource 1.0
47.96ROUGE-1SOV-MAS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SOV-MASTraining Setting=Multilingual Training, Language=Japanese2022.12 | 47.96 | 23.76 | 36.78 | |
| mT5Training Setting=Multilingual Training, Language=Japanese2022.12 | 47.36 | 22.2 | 35.88 | |
| VG-mT5Training Setting=Multilingual Training, Language=Japanese2022.12 | 46.65 | 22.66 | 35.68 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Japanese2022.12 | 45.97 | 22.63 | 35.84 | |
| VG-mT5Training Setting=Monolingual Training, Language=Japanese2022.12 | 45.03 | 21.64 | 34.99 | |
| mT5Training Setting=Monolingual Training, Language=Japanese2022.12 | 44.54 | 21.33 | 34.44 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Hausa2022.12 | 39.4 | 17.53 | 31.04 | |
| mT5Training Setting=Multilingual Training, Language=Hausa2022.12 | 38.37 | 16.59 | 30.34 | |
| VG-mT5Training Setting=Multilingual Training, Language=Hausa2022.12 | 38.14 | 16.6 | 30.45 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Pashto2022.12 | 38.11 | 15.53 | 31.44 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Swahili2022.12 | 38.04 | 17.87 | 30.99 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Pidgin2022.12 | 38.02 | 15.31 | 30.07 | |
| mT5Training Setting=Multilingual Training, Language=Pashto2022.12 | 37.34 | 14.41 | 30.39 | |
| VG-mT5Training Setting=Multilingual Training, Language=Pashto2022.12 | 37.21 | 14.7 | 30.59 | |
| VG-mT5Training Setting=Multilingual Training, Language=Pidgin2022.12 | 37.21 | 14.48 | 29.14 | |
| VG-mT5Training Setting=Multilingual Training, Language=Swahili2022.12 | 37.19 | 17.23 | 30.33 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Hausa2022.12 | 36.81 | 15.31 | 29.12 | |
| mT5Training Setting=Multilingual Training, Language=Swahili2022.12 | 36.75 | 16.26 | 29.49 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Pashto2022.12 | 36.45 | 14.06 | 29.79 | |
| mT5Training Setting=Monolingual Training, Language=Hausa2022.12 | 36.36 | 15.37 | 28.85 | |
| mT5Training Setting=Multilingual Training, Language=Pidgin2022.12 | 36.33 | 13.6 | 28.29 | |
| mT5Training Setting=Monolingual Training, Language=Pashto2022.12 | 36.14 | 14.06 | 29.74 | |
| SOV-MASTraining Setting=Multilingual Training, Language=French2022.12 | 36.06 | 16.36 | 28.63 | |
| VG-mT5Training Setting=Monolingual Training, Language=Pashto2022.12 | 35.97 | 14.08 | 29.67 | |
| VG-mT5Training Setting=Monolingual Training, Language=Hausa2022.12 | 35.69 | 14.75 | 28.22 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Pidgin2022.12 | 35.58 | 13.02 | 27.46 | |
| mT5Training Setting=Monolingual Training, Language=Pidgin2022.12 | 35.22 | 12.93 | 27.27 | |
| VG-mT5Training Setting=Monolingual Training, Language=Pidgin2022.12 | 35.14 | 12.88 | 27.27 | |
| VG-mT5Training Setting=Multilingual Training, Language=French2022.12 | 34.94 | 15.41 | 27.56 | |
| VG-mT5Training Setting=Monolingual Training, Language=Swahili2022.12 | 34.79 | 15.07 | 28 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Swahili2022.12 | 34.56 | 14.99 | 27.75 | |
| mT5Training Setting=Multilingual Training, Language=French2022.12 | 34.36 | 14.9 | 26.92 | |
| mT5Training Setting=Monolingual Training, Language=Swahili2022.12 | 34.22 | 14.76 | 27.61 | |
| SOV-MASTraining Setting=Monolingual Training, Language=French2022.12 | 33.16 | 14.21 | 25.89 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Welsh2022.12 | 32.89 | 11.79 | 26.1 | |
| VG-mT5Training Setting=Monolingual Training, Language=French2022.12 | 32.41 | 13.4 | 25.5 | |
| mT5Training Setting=Monolingual Training, Language=French2022.12 | 32.05 | 12.98 | 25.06 | |
| VG-mT5Training Setting=Multilingual Training, Language=Welsh2022.12 | 31.91 | 10.62 | 25.08 | |
| mT5Training Setting=Multilingual Training, Language=Welsh2022.12 | 31.86 | 10.88 | 25.06 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Welsh2022.12 | 31.32 | 10.97 | 24.77 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Punjabi2022.12 | 30.78 | 12.1 | 25.52 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Avg.2022.12 | 30.71 | 12.57 | 25.25 | |
| VG-mT5Training Setting=Monolingual Training, Language=Welsh2022.12 | 30.63 | 9.78 | 24.23 | |
| mT5Training Setting=Monolingual Training, Language=Welsh2022.12 | 30.41 | 9.23 | 24.11 | |
| mT5Training Setting=Multilingual Training, Language=Punjabi2022.12 | 29.98 | 11.14 | 24.41 | |
| VG-mT5Training Setting=Multilingual Training, Language=Punjabi2022.12 | 29.75 | 11.48 | 24.72 | |
| mT5Training Setting=Multilingual Training, Language=Avg.2022.12 | 29.64 | 11.53 | 24.11 | |
| VG-mT5Training Setting=Multilingual Training, Language=Avg.2022.12 | 29.59 | 11.79 | 24.32 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Bengali2022.12 | 28.89 | 11.69 | 24.59 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Punjabi2022.12 | 28.25 | 10.57 | 23.14 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Avg.2022.12 | 28.16 | 10.9 | 23.06 | |
| mT5Training Setting=Multilingual Training, Language=Bengali2022.12 | 27.95 | 10.64 | 23.43 | |
| VG-mT5Training Setting=Monolingual Training, Language=Avg.2022.12 | 27.55 | 10.47 | 22.59 | |
| mT5Training Setting=Monolingual Training, Language=Punjabi2022.12 | 27.43 | 10.07 | 22.68 | |
| mT5Training Setting=Monolingual Training, Language=Avg.2022.12 | 27.42 | 10.38 | 22.52 | |
| VG-mT5Training Setting=Multilingual Training, Language=Bengali2022.12 | 27.34 | 10.87 | 23.42 | |
| VG-mT5Training Setting=Monolingual Training, Language=Punjabi2022.12 | 27.27 | 9.76 | 22.44 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Bengali2022.12 | 26.76 | 10.08 | 23.07 | |
| VG-mT5Training Setting=Monolingual Training, Language=Bengali2022.12 | 26.02 | 9.88 | 22.14 | |
| mT5Training Setting=Monolingual Training, Language=Bengali2022.12 | 25.34 | 9.52 | 22.04 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Serbian Cyrillic2022.12 | 23.85 | 7.93 | 20.06 | |
| mT5Training Setting=Multilingual Training, Language=Serbian Cyrillic2022.12 | 23.11 | 7.18 | 19.14 | |
| VG-mT5Training Setting=Multilingual Training, Language=Serbian Cyrillic2022.12 | 22.92 | 7.43 | 19.39 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Marathi2022.12 | 22.59 | 9.98 | 20.39 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Serbian Latin2022.12 | 22.39 | 6.84 | 18.59 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Gujarati2022.12 | 22.31 | 8.12 | 20.14 | |
| mT5Training Setting=Multilingual Training, Language=Marathi2022.12 | 21.91 | 9.52 | 19.64 | |
| VG-mT5Training Setting=Multilingual Training, Language=Marathi2022.12 | 21.72 | 9.49 | 19.82 | |
| mT5Training Setting=Multilingual Training, Language=Gujarati2022.12 | 21.59 | 7.38 | 19.26 | |
| VG-mT5Training Setting=Multilingual Training, Language=Gujarati2022.12 | 21.44 | 7.61 | 19.46 | |
| mT5Training Setting=Multilingual Training, Language=Serbian Latin2022.12 | 21.28 | 6.04 | 17.41 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Marathi2022.12 | 21.08 | 9.46 | 19.09 | |
| VG-mT5Training Setting=Multilingual Training, Language=Serbian Latin2022.12 | 20.66 | 5.82 | 17.21 | |
| VG-mT5Training Setting=Monolingual Training, Language=Marathi2022.12 | 20.6 | 9.06 | 18.75 | |
| mT5Training Setting=Monolingual Training, Language=Marathi2022.12 | 20.39 | 8.96 | 18.65 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Telugu2022.12 | 20.19 | 7.38 | 17.91 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Gujarati2022.12 | 19.83 | 6.64 | 18.02 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Serbian Cyrillic2022.12 | 19.8 | 5.2 | 16.41 | |
| VG-mT5Training Setting=Monolingual Training, Language=Gujarati2022.12 | 19.45 | 6.26 | 17.65 | |
| mT5Training Setting=Monolingual Training, Language=Gujarati2022.12 | 19.3 | 6.34 | 17.74 | |
| SOV-MASTraining Setting=Multilingual Training, Language=Oromo2022.12 | 19.13 | 6.29 | 16.47 | |
| VG-mT5Training Setting=Monolingual Training, Language=Serbian Cyrillic2022.12 | 19.01 | 4.92 | 15.72 | |
| VG-mT5Training Setting=Multilingual Training, Language=Telugu2022.12 | 18.92 | 6.77 | 16.84 | |
| mT5Training Setting=Multilingual Training, Language=Telugu2022.12 | 18.68 | 6.5 | 16.52 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Serbian Latin2022.12 | 18.55 | 4.75 | 15.29 | |
| mT5Training Setting=Monolingual Training, Language=Serbian Cyrillic2022.12 | 18.52 | 4.9 | 15.44 | |
| mT5Training Setting=Monolingual Training, Language=Serbian Latin2022.12 | 18.5 | 4.4 | 15.11 | |
| VG-mT5Training Setting=Monolingual Training, Language=Serbian Latin2022.12 | 18.49 | 4.67 | 15.42 | |
| VG-mT5Training Setting=Multilingual Training, Language=Oromo2022.12 | 17.82 | 5.75 | 15.2 | |
| mT5Training Setting=Multilingual Training, Language=Oromo2022.12 | 17.77 | 5.72 | 15.53 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Telugu2022.12 | 17.56 | 6.09 | 15.66 | |
| VG-mT5Training Setting=Monolingual Training, Language=Telugu2022.12 | 17.2 | 5.95 | 15.3 | |
| mT5Training Setting=Monolingual Training, Language=Telugu2022.12 | 17.06 | 5.83 | 15.29 | |
| SOV-MASTraining Setting=Monolingual Training, Language=Oromo2022.12 | 16.68 | 5.39 | 14.6 | |
| mT5Training Setting=Monolingual Training, Language=Oromo2022.12 | 15.91 | 5.03 | 13.91 | |
| VG-mT5Training Setting=Monolingual Training, Language=Oromo2022.12 | 15.65 | 4.95 | 13.67 |