Summarization on CNN/DailyMail full-length F1 (test)
42.37ROUGE-1HIBERTM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HIBERTMType=Extractive, Size=Medium/Large2019.05 | 42.37 | 19.95 | 38.83 | |
| HIBERTSType=Extractive, Pre-training stages=22019.05 | 42.31 | 19.87 | 38.78 | |
| HIBERTS (in-domain)Type=Extractive, Pre-training=In-domain CNNDM2019.05 | 42.1 | 19.7 | 38.53 | |
| BERTType=Extractive, Backbone=BERT-base2019.05 | 41.82 | 19.48 | 38.3 | |
| JECSType=Extractive2019.05 | 41.7 | 18.5 | 37.9 | |
| DCAType=Abstractive2019.05 | 41.69 | 19.47 | 37.92 | |
| NeuSum-MMRType=Extractive2019.05 | 41.59 | 19.01 | 37.98 | |
| BanditSumType=Extractive2019.05 | 41.5 | 18.7 | 37.6 | |
| Bottom-UpType=Abstractive2019.05 | 41.22 | 18.68 | 38.34 | |
| HierTransformerType=Extractive, L=4, H=300, A=42019.05 | 41.11 | 18.69 | 37.53 | |
| LatentSumType=Extractive2019.05 | 41.05 | 18.77 | 37.54 | |
| SentRewriteType=Abstractive2019.05 | 40.88 | 17.8 | 38.54 | |
| InconsisLossType=Abstractive2019.05 | 40.68 | 17.97 | 37.13 | |
| Lead3Type=Extractive2019.05 | 40.34 | 17.7 | 36.57 | |
| NeuSumType=Extractive2019.05 | 40.11 | 17.52 | 36.39 | |
| RefreshType=Extractive2019.05 | 40 | 18.2 | 36.6 | |
| Abstract-ML+RLType=Abstractive2019.05 | 39.87 | 15.82 | 36.9 | |
| SummaRuNNerType=Extractive2019.05 | 39.6 | 16.2 | 35.3 | |
| Pointer+CoverageType=Abstractive2019.05 | 39.53 | 17.28 | 36.38 |