Multi-document Summarization on arXiv (test)
34.6ROUGE-1PRIMERA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PRIMERAzero-shot=true, output length limit=3002021.10 | 34.6 | 9.4 | 18.3 | |
| PEGASUSzero-shot=true, source=our run, output length limit=3002021.10 | 29.5 | 7.9 | 17.1 | |
| BARTzero-shot=true, source=our run, output length limit=3002021.10 | 29.2 | 7.5 | 16.9 | |
| PEGASUSzero-shot=true, source=Zhang et al., 2020, output length limit=300, attention type=full-length attention (O(n^2)), pretrained on=single document datasets2021.10 | 28.1 | 6.6 | 17.7 | |
| LEDzero-shot=true, source=our run, output length limit=3002021.10 | 15 | 3.1 | 10.8 |