Summarization on WikiLingua (test)
60.22ROUGE-1ViT5_large 1024-length
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ViT5_large 1024-lengthModel size=large, Pre-training sequence length=10242022.05 | 60.22 | 33.12 | 43.08 | |
| ViT5_base 1024-lengthModel size=base, Pre-training sequence length=10242022.05 | 58.61 | 31.46 | 41.45 | |
| ViT5_base 256-lengthModel size=base, Pre-training sequence length=2562022.05 | 57.86 | 29.98 | 40.23 | |
| BARTpho2022.05 | 57.16 | 31.18 | 40.89 | |
| mT52022.05 | 55.27 | 27.63 | 38.3 | |
| mBART2022.05 | 55.21 | 25.69 | 37.33 | |
| mBERT2mBERT2022.05 | 52.82 | 20.57 | 31.55 | |
| PhoBERT2PhoBERT2022.05 | 50.4 | 19.88 | 32.49 | |
| Transformer (RND2RND)Initialization=random weights2022.05 | 46.25 | 16.57 | 29.82 |