Summarization on DUC 2002 (test)
47.6ROUGE-1ITS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ITSSummary Length=75 bytes, Metric Type=Recall2018.09 | 47.6 | 23.4 | 43.5 | |
| Cheng et al. '16Summary Length=75 bytes, Metric Type=Recall2018.09 | 47.4 | 23 | 43.5 | |
| Hybrid MemNetSummary Length=75 bytes, Metric Type=Recall2018.09 | 46.9 | 23 | 43.1 | |
| SummaRuNNerSummary Length=75 bytes, Metric Type=Recall2018.09 | 46.6 | 23.1 | 43 | |
| ILPSummary Length=75 bytes, Metric Type=Recall2018.09 | 45.4 | 21.3 | 42.8 | |
| LRegSummary Length=75 bytes, Metric Type=Recall2018.09 | 43.8 | 20.7 | 40.3 | |
| Lead-3Summary Length=75 bytes, Metric Type=Recall2018.09 | 43.6 | 21 | 40.2 | |
| BERT-ext + abs + RLtraining=RL2019.09 | 43.39 | 19.38 | 40.14 | |
| BERT-ext + abs + RL2019.09 | 43.39 | 19.38 | 40.14 | |
| rnn-ext + abs + RL2018.05 | 39.46 | 17.34 | 36.72 | |
| Sentence Rewrite2019.09 | 39.46 | 17.34 | 36.72 | |
| Sentence Rewrite2019.09 | 39.46 | 17.34 | 36.72 | |
| See et al. (2017)2018.05 | 37.22 | 15.78 | 33.9 | |
| Pointer Generator2019.09 | 37.22 | 15.78 | 33.9 | |
| Pointer Generator2019.09 | 37.22 | 15.78 | 33.9 | |
| Multi-Task (EG + QG)Trained on=CNN/DailyMail, Auxiliary Tasks=Entailment Generation (EG) + Question Generation (QG)2018.05 | 36.73 | 16.15 | 33.58 | |
| BaselineTrained on=CNN/DailyMail2018.05 | 35.96 | 15.91 | 32.92 | |
| See et al. (2017)Architecture=Pointer-coverage model, Trained on=CNN/DailyMail2018.05 | 34.3 | 14.25 | 30.82 |