Summarization on CNN/DM (Human Evaluation)
24Informational Content ScoreSummScore
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SummScoreUse case=0-shot transfer from XSum2022.12 | 24 | — | — | — | — | — | — | 18.67 | |
| SummScoreUse case=unsupervised abs. summ.2022.12 | 20.67 | — | — | — | — | — | — | 19.33 | |
| PEGASUSUse case=unsupervised abs. summ.2022.12 | 11.33 | — | — | — | — | — | — | 14.67 | |
| PEGASUSUse case=0-shot transfer from XSum2022.12 | 5.67 | — | — | — | — | — | — | 4.67 | |
| FESbaseline_model=BART2022.10 | — | 6 | 72 | 22 | 7 | 81 | 12 | — | |
| SimCLSbaseline_model=BART2022.10 | — | 9 | 75 | 16 | 7 | 85 | 8 | — |