Summarization on CNNDM (test)
37.82ROUGE 2Oracle (EDUs)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Oracle (EDUs)Category=Oracle2026.04 | 37.82 | — | — | — | 61.61 | 59.27 | |
| SEASON2022.10 | 22.64 | — | — | — | 46.27 | 43.08 | |
| T5Number of Parameters=11B2022.08 | 22.6 | — | — | — | — | — | |
| CIT + SE2022.10 | 22.53 | — | — | — | 45.8 | 42.48 | |
| GSum2022.10 | 22.32 | — | — | — | 45.94 | 42.48 | |
| Z-Code++_LARGENumber of Parameters=710M2022.08 | 22.2 | — | — | — | — | — | |
| Q-PFull name=QUALS-Positive2021.05 | 21.65 | 4.37 | 83.84 | 69.4 | 44.62 | 41.47 | |
| Q-C-OFull name=QUALS-CONSEQ-Online2021.05 | 21.58 | 2.92 | 83.08 | 68.16 | 44.7 | 41.53 | |
| PEGASUS2022.10 | 21.47 | — | — | — | 44.17 | 41.11 | |
| PEGASUS_LARGENumber of Parameters=470M2022.08 | 21.4 | — | — | — | — | — | |
| Q-CFull name=QUALS-CONSEQ2021.05 | 21.37 | 8.57 | 84.75 | 72.83 | 44.4 | 41.17 | |
| MLEBackbone=BART-large2021.05 | 21.35 | 1.69 | 82.84 | 68.33 | 44.24 | 41.18 | |
| HAHSum2022.10 | 21.3 | — | — | — | 44.68 | 40.75 | |
| BARTImplementation=Prior paper2022.10 | 21.28 | — | — | — | 44.16 | 40.9 | |
| Q-F1-CFull name=QUALS-F1-CONSEQ2021.05 | 21.24 | 7.79 | 84.97 | 70.54 | 44.23 | 40.96 | |
| BARTImplementation=Reproduced by authors2022.10 | 21.23 | — | — | — | 44.21 | 41.17 | |
| Longformer with MLP for RST & CorefCategory=Hybrid, Backbone=Longformer, Components=MLP for RST & Coref2026.04 | 20.91 | — | — | — | 43.73 | 40.72 | |
| Q-C-WFull name=QUALS-CONSEQ-Weighted2021.05 | 20.88 | 7.2 | 83.54 | 70.03 | 44.04 | 40.74 | |
| MatchSum2022.10 | 20.86 | — | — | — | 44.41 | 40.55 | |
| DiscoBERT w RST & CorefCategory=Extractive, Components=RST & Coref2026.04 | 20.85 | — | — | — | 43.77 | 40.67 | |
| DiscoBERT w RSTCategory=Extractive, Components=RST2026.04 | 20.71 | — | — | — | 43.68 | 40.54 | |
| DiscoBERT w CorefCategory=Extractive, Components=Coref2026.04 | 20.64 | — | — | — | 43.58 | 40.42 | |
| DiscoBERTCategory=Extractive2026.04 | 20.44 | — | — | — | 43.38 | 40.21 | |
| BERTSUMEXTCategory=Extractive2026.04 | 20.24 | — | — | — | 43.25 | 39.63 | |
| BERTSUMEXTABSCategory=Hybrid2026.04 | 19.6 | — | — | — | 42.13 | 39.18 | |
| BERTSUMABSCategory=Abstractive2026.04 | 19.39 | — | — | — | 41.72 | 38.76 | |
| BART-baseCategory=Abstractive, Backbone=BART-base2026.04 | 18.49 | — | — | — | 41.44 | 38.32 | |
| R-CFull name=ROUGE-CONSEQ2021.05 | 18.41 | -7.01 | 79.28 | 63.5 | 41.17 | 37.94 | |
| LEAD-32022.10 | 17.7 | — | — | — | 40.34 | 36.57 | |
| Lead3Category=Oracle2026.04 | 17.62 | — | — | — | 40.42 | 36.67 | |
| Point-Generator2022.10 | 17.28 | — | — | — | 39.53 | 36.38 |