Abstractive Summarization on CNN/DM
42.05ROUGE-1SummScore - LEAD-3
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SummScore - LEAD-3Backbone=ChatGPT, Candidate Selection=SummScore - LEAD-32022.12 | 42.05 | 18.2 | 38.06 | 87.97 | 4.23 | |
| SummScore - Random-3Backbone=ChatGPT, Candidate Selection=SummScore - Random-32022.12 | 41.82 | 18.11 | 37.88 | 87.91 | 3.69 | |
| FirstBackbone=ChatGPT, Candidate Selection=First2022.12 | 40.79 | 16.61 | 36.92 | 87.93 | — | |
| SummScore - Salient-R1Backbone=ChatGPT, Candidate Selection=SummScore - Salient-R12022.12 | 40.3 | 17.1 | 36.37 | 87.67 | -0.57 | |
| SummScore - Salient-RLBackbone=ChatGPT, Candidate Selection=SummScore - Salient-RL2022.12 | 40.24 | 17.06 | 36.29 | 87.66 | -0.76 | |
| SummScore - Salient-R2Backbone=ChatGPT, Candidate Selection=SummScore - Salient-R22022.12 | 40.2 | 17.06 | 36.23 | 87.65 | -0.88 | |
| SummScore - Salient-R2Backbone=PEGASUS, Candidate Selection=SummScore - Salient-R22022.12 | 35.65 | 14.12 | 32.14 | 86.24 | 1.19 | |
| SummScore - Salient-R1Backbone=PEGASUS, Candidate Selection=SummScore - Salient-R12022.12 | 35.54 | 14.05 | 32.04 | 86.22 | 0.85 | |
| SummScore - Salient-RLBackbone=PEGASUS, Candidate Selection=SummScore - Salient-RL2022.12 | 35.54 | 14.05 | 32.04 | 86.22 | 0.85 | |
| SummScore - Random-3Backbone=PEGASUS, Candidate Selection=SummScore - Random-32022.12 | 35.47 | 13.89 | 31.61 | 86.28 | 0.85 | |
| SummScore - LEAD-3Backbone=PEGASUS, Candidate Selection=SummScore - LEAD-32022.12 | 34.89 | 13.46 | 31.22 | 86.11 | -1.67 | |
| Top beamBackbone=PEGASUS, Candidate Selection=Top beam2022.12 | 32.9 | 13.28 | 29.38 | 86.29 | — | |
| RandomBackbone=ChatGPT, Candidate Selection=Random2022.12 | 30.48 | 10 | 22.16 | 88.78 | — | |
| Random beamBackbone=PEGASUS, Candidate Selection=Random beam2022.12 | 19.27 | 3 | 12.72 | — | — |