Extractive Summarization on CNN/DM (test)
52.59ROUGE-1ORACLE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ORACLE2020.04 | 52.59 | 31.23 | 48.87 | |
| MATCH-ORACLE2020.04 | 51.08 | 26.94 | 47.22 | |
| MATCHSUM (ROBERTa-base)Encoder Backbone=ROBERTa-base2020.04 | 44.41 | 20.86 | 40.55 | |
| MATCHSUM (BERT-base)Encoder Backbone=BERT-base2020.04 | 44.22 | 20.62 | 40.38 | |
| BERTSUM*Encoder Size=large2020.04 | 43.85 | 20.34 | 39.9 | |
| BERTEXT + Tri-BlockingPost-processing=Tri-Blocking2020.04 | 43.23 | 20.22 | 39.6 | |
| BERTEXT + Tri-Blocking (Ours)Post-processing=Tri-Blocking2020.04 | 43.18 | 20.16 | 39.56 | |
| BERTEXT + RL2020.04 | 42.76 | 19.87 | 39.11 | |
| BERTEXT (Ours)2020.04 | 42.73 | 20.13 | 39.2 | |
| PNBERT + RL2020.04 | 42.69 | 19.6 | 38.85 | |
| BERTEXT2020.04 | 42.57 | 19.96 | 39.04 | |
| PNBERT2020.04 | 42.39 | 19.51 | 38.69 | |
| HIBERT2020.04 | 42.37 | 19.95 | 38.83 | |
| BERTEXT†Pointer Network=true2020.04 | 42.29 | 19.38 | 38.63 | |
| JECS2020.04 | 41.7 | 18.5 | 37.9 | |
| NEUSUM2020.04 | 41.59 | 19.01 | 37.98 | |
| BANDITSUM2020.04 | 41.5 | 18.7 | 37.6 | |
| LEAD2020.04 | 40.43 | 17.62 | 36.67 |