Summarization on Vietnews (test)
63.37ROUGE-1ViT5_large 1024-length
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ViT5_large 1024-lengthModel size=large, Pre-training sequence length=10242022.05 | 63.37 | 34.24 | 43.55 | |
| ViT5_base 1024-lengthModel size=base, Pre-training sequence length=10242022.05 | 62.77 | 33.16 | 42.75 | |
| ViT5_base 256-lengthModel size=base, Pre-training sequence length=2562022.05 | 61.85 | 31.7 | 41.7 | |
| BARTpho2022.05 | 61.14 | 30.31 | 40.15 | |
| BARTphowordduplicate_article_removal=false, tokenization=word-segmented2021.09 | 61.14 | 30.31 | 40.15 | |
| BARTphosyllableduplicate_article_removal=false, tokenization=syllable2021.09 | 60.88 | 29.9 | 39.64 | |
| PhoBERT2PhoBERT2022.05 | 60.37 | 29.12 | 39.44 | |
| PhoBERT2PhoBERTduplicate_article_removal=false2021.09 | 60.37 | 29.12 | 39.44 | |
| mBARTduplicate_article_removal=false2021.09 | 60.35 | 29.13 | 39.21 | |
| mBART2022.05 | 59.81 | 28.28 | 38.71 | |
| viBERT2viBERTduplicate_article_removal=false2021.09 | 59.75 | 27.29 | 36.79 | |
| mBERT2mBERT2022.05 | 59.67 | 27.36 | 36.73 | |
| mT52022.05 | 58.05 | 26.76 | 37.38 | |
| mT5duplicate_article_removal=false2021.09 | 58.05 | 26.76 | 37.38 | |
| Transformer (RND2RND)Initialization=random weights2022.05 | 57.56 | 24.25 | 35.53 | |
| fastAbsduplicate_article_removal=false2021.09 | 54.52 | 23.01 | 37.64 |