Multimodal Abstractive Summarization on MM-Sum Japanese low-resource
47.79ROUGE-1 ScoreSOV-MAS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SOV-MASTraining Setting=Multilingual Training, Visual Features=ViT2022.12 | 47.79 | 23.67 | 36.72 | |
| mT5Training Setting=Multilingual Training, Visual Features=ViT2022.12 | 47.36 | 22.2 | 35.88 | |
| VG-mT5Training Setting=Multilingual Training, Visual Features=ViT2022.12 | 46.77 | 22.61 | 35.79 | |
| SOV-MASTraining Setting=Monolingual Training, Visual Features=ViT2022.12 | 45.91 | 22.59 | 35.81 | |
| VG-mT5Training Setting=Monolingual Training, Visual Features=ViT2022.12 | 44.89 | 21.62 | 34.87 | |
| mT5Training Setting=Monolingual Training, Visual Features=ViT2022.12 | 44.54 | 21.33 | 34.44 |