Multi-Document Summarization on WikiSUM (test)
44.33ROUGE-1BASS
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BASSlength_limit=30002021.05 | 44.33 | 28.38 | 37.87 | 31.71 | |
| BASSlength_limit=24002021.05 | 43.65 | 28.55 | 37.85 | 31.91 | |
| GraphSum2021.05 | 42.99 | 27.83 | 37.36 | 29.69 | |
| RoBERTaS2S2021.05 | 42.05 | 27 | 36.56 | 29.13 | |
| HT2021.05 | 41.53 | 26.52 | 35.76 | 25.62 | |
| BERTS2S2021.05 | 41.49 | 25.73 | 35.59 | — | |
| T-DMCA2021.05 | 40.77 | 25.6 | 34.9 | — | |
| TransS2S2021.05 | 40.56 | 25.35 | 34.73 | 25.43 | |
| Lead2021.05 | 38.22 | 16.85 | 26.89 | — | |
| LexRank2021.05 | 36.12 | 11.67 | 22.52 | — | |
| PRIMERAzero-shot=true, output length limit=1282021.10 | 28 | 8 | 18 | — | |
| PEGASUSzero-shot=true, source=our run, output length limit=1282021.10 | 24.6 | 5.5 | 15 | — | |
| BARTzero-shot=true, source=our run, output length limit=1282021.10 | 21.6 | 5.5 | 15 | — | |
| LEDzero-shot=true, source=our run, output length limit=1282021.10 | 10.5 | 2.4 | 8.6 | — |