Abstractive Summarization on CNN/DailyMail
44.51ROUGE-1BART + RD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BART + RD2021.06 | 44.51 | 21.58 | 41.24 | |
| BART + R3F2021.06 | 44.38 | 21.53 | 41.17 | |
| PEGASUS(HugeNews)Data=3.8T, Params=568M2020.01 | 44.17 | 21.47 | 41.11 | |
| PEGASUS2021.06 | 44.17 | 21.47 | 41.11 | |
| BART LARGEData=430G, Params=400M2020.01 | 44.16 | 21.28 | 40.9 | |
| PEGASUS_LARGEPre-training strategy=mixed, stochastic2019.12 | 44.16 | 21.56 | 41.3 | |
| BART2021.06 | 44.16 | 21.28 | 40.9 | |
| ERNIE-GEN LARGEData=16G, Params=340M2020.01 | 44.02 | 21.17 | 41.26 | |
| ProphetNet2021.06 | 44.02 | 21.17 | 41.3 | |
| PEGASUS(C4)Data=750G, Params=568M2020.01 | 43.9 | 21.2 | 40.76 | |
| T5 XLARGEData=750G, Params=11B2020.01 | 43.52 | 21.55 | 40.69 | |
| UNILMLARGEData=16G, Params=340M2020.01 | 43.33 | 20.21 | 40.51 | |
| T5 LARGEData=750G, Params=340M2020.01 | 42.5 | 20.68 | 39.75 | |
| ERNIE-GEN BASEData=16G, Params=110M2020.01 | 42.3 | 19.92 | 39.68 | |
| MASSData=18G, Params=160M2020.01 | 42.12 | 19.5 | 39.01 | |
| BERTSUMABSData=16G, Params=110M2020.01 | 41.72 | 19.39 | 38.76 | |
| GHT-PSParameters=30M, Inference Speed=257.62 sent/s, FLOPs=1558M2023.05 | 40.01 | 21.31 | 37.62 | |
| GHTParameters=44M, Inference Speed=208.77 sent/s, FLOPs=1996M2023.05 | 40 | 21.1 | 37.51 | |
| Dynamic ConvParameters=87M2023.05 | 39.84 | 16.25 | 36.73 | |
| Light ConvParameters=86M2023.05 | 39.52 | 15.97 | 36.51 | |
| Transformer2021.06 | 39.5 | 16.06 | 36.63 | |
| BERTSHAREData=16G, Params=110M2020.01 | 39.25 | 18.09 | 36.45 | |
| CNN2023.05 | 39.06 | 15.38 | 35.77 | |
| Vanilla TransformerParameters=44M, Inference Speed=208.77 sent/s, FLOPs=1996M2023.05 | 38.45 | 17.97 | 36.03 | |
| LSTM2023.05 | 38.3 | 14.81 | 35.49 |