Multi-document Summarization on Multi-XSci (test)
34.11ROUGE-1SOTA(Pointer Generator)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SOTA(Pointer Generator)Evaluation Source=Lu et al. (2020)2021.10 | 34.11 | 6.76 | 18.2 | |
| BARTEvaluation Source=Lu et al. (2020)2021.10 | 32.83 | 6.36 | — | |
| SCIBERTABSEvaluation Source=Lu et al. (2020)2021.10 | 32.12 | 5.59 | — | |
| PRIMERAEvaluation Source=Current Paper, Evaluation Protocol=Author-specific ROUGE-L settings2021.10 | 31.93 | 7.37 | 18.02 | |
| BERTABSEvaluation Source=Lu et al. (2020)2021.10 | 31.56 | 5.02 | — | |
| PRIMERAzero-shot=true, output length limit=1282021.10 | 29.1 | 4.6 | 15.7 | |
| PEGASUSzero-shot=true, source=our run, output length limit=1282021.10 | 27.6 | 4.6 | 15.3 | |
| LEADEvaluation Source=Lu et al. (2020)2021.10 | 27.46 | 4.57 | — | |
| LEADEvaluation Source=Current Paper, Evaluation Protocol=Author-specific ROUGE-L settings2021.10 | 26.49 | 4.26 | 14.7 | |
| BARTzero-shot=true, source=our run, output length limit=1282021.10 | 18.9 | 2.6 | 12.3 | |
| LEDzero-shot=true, source=our run, output length limit=1282021.10 | 14.6 | 1.9 | 9.9 |