Abstractive Summarization on BillSum 24k samples (test)
57.31ROUGE-1PEGASUSLARGE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PEGASUSLARGEModel Size=Large, Pre-training Corpus=HugeNews2019.12 | 57.31 | 40.19 | 45.82 | |
| PEGASUSLARGEModel Size=Large, Pre-training Corpus=C42019.12 | 57.2 | 39.56 | 45.8 | |
| PEGASUSBASEModel Size=Base2019.12 | 51.42 | 29.68 | 37.78 | |
| TransformerBASEModel Size=Base2019.12 | 44.05 | 21.3 | 30.98 | |
| Previous SOTA2019.12 | 40.8 | 23.83 | 33.73 |