Multimodal Abstractive Summarization on MM-Sum Avg., low-resource
30.55ROUGE-1 ScoreSOV-MAS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SOV-MASTraining Setting=Multilingual Training, Visual Features=ViT2022.12 | 30.55 | 12.54 | 25.15 | |
| mT5Training Setting=Multilingual Training, Visual Features=ViT2022.12 | 29.64 | 11.53 | 24.11 | |
| VG-mT5Training Setting=Multilingual Training, Visual Features=ViT2022.12 | 29.59 | 11.77 | 24.31 | |
| SOV-MASTraining Setting=Monolingual Training, Visual Features=ViT2022.12 | 28.09 | 10.85 | 23.04 | |
| VG-mT5Training Setting=Monolingual Training, Visual Features=ViT2022.12 | 27.53 | 10.45 | 22.61 | |
| mT5Training Setting=Monolingual Training, Visual Features=ViT2022.12 | 27.42 | 10.38 | 22.52 |