Summarization on CNN/Daily Mail full length (test)
43.25ROUGE-1BERTSUM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BERTSUMapproach=Extractive2019.09 | 43.25 | 20.24 | 39.63 | 34.37 | |
| BERT-ext + RLapproach=Extractive, Backbone=BERT-Base, Reinforcement Learning=true2019.09 | 42.76 | 19.87 | 39.11 | 33.91 | |
| HiBERTapproach=Extractive2019.09 | 42.37 | 19.95 | 38.83 | 33.71 | |
| BERT-extapproach=Extractive, Backbone=BERT-Base2019.09 | 42.29 | 19.38 | 38.63 | 33.43 | |
| BERT-ext + abs + RL + rerankapproach=Abstractive, Backbone=BERT-Base, Reinforcement Learning=true, Reranking=true2019.09 | 41.9 | 19.08 | 39.64 | 33.54 | |
| Two-Stage BERTapproach=Abstractive, Two-Stage Processing=true2019.09 | 41.71 | 19.49 | 38.79 | 33.33 | |
| JECSapproach=Extractive2019.09 | 41.7 | 18.5 | 37.9 | 32.7 | |
| Bottom-Upapproach=Abstractive2019.09 | 41.22 | 18.68 | 38.34 | 32.75 | |
| BERT-ext + abs + RLapproach=Abstractive, Backbone=BERT-Base, Reinforcement Learning=true2019.09 | 41 | 18.81 | 38.51 | 32.77 | |
| Sentence Rewriteapproach=Abstractive, rerank=true2019.09 | 40.88 | 17.8 | 38.54 | 32.41 | |
| BERT-ext + abs + rerankapproach=Abstractive, Backbone=BERT-Base, Reranking=true2019.09 | 40.71 | 17.92 | 38.51 | 32.38 | |
| Inconsistency Lossapproach=Abstractive2019.09 | 40.68 | 17.97 | 37.13 | 31.93 | |
| lead-3approach=Extractive2019.09 | 40.34 | 17.7 | 36.57 | 31.54 | |
| BERT-ext + absapproach=Abstractive, Backbone=BERT-Base2019.09 | 40.14 | 17.87 | 37.83 | 31.95 | |
| Sentence Rewrite (w/o rerank)approach=Abstractive, rerank=false2019.09 | 40.04 | 17.61 | 37.59 | 31.74 | |
| REFRESHapproach=Extractive2019.09 | 40 | 18.2 | 36.6 | 31.6 | |
| Pointer Generatorapproach=Abstractive2019.09 | 39.53 | 17.28 | 36.38 | 31.06 | |
| Transformer-LMapproach=Abstractive, Backbone=Transformer-LM2019.09 | 38.67 | 17.47 | 35.79 | 30.64 |