Summarization on PubMed
50.23ROUGE-1LongT5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LongT5Model Size=xl, Input Length=16k, Attention=TGlobal2021.12 | 50.23 | 24.76 | — | 46.67 | |
| LongT5Model Size=xl, Input Length=8k, Attention=TGlobal2021.12 | 50.04 | 24.45 | — | 46.42 | |
| LongT5Model Size=large, Input Length=16k, Attention=TGlobal2021.12 | 49.98 | 24.69 | — | 46.46 | |
| LongT5Model Size=large, Input Length=8k, Attention=TGlobal2021.12 | 49.81 | 24.3 | — | 46.26 | |
| GloSA-sum2026.02 | 49.5 | 22.5 | — | 44.5 | |
| MemSum2026.02 | 49.14 | 22.92 | — | 44.33 | |
| BERTSum2026.02 | 49.1 | 24.3 | — | 25.7 | |
| LongT5Model Size=xl, Input Length=4k, Attention=TGlobal2021.12 | 48.99 | 23.48 | — | 45.51 | |
| T5.1.1 + PSGModel Size=large, Input Length=4k2021.12 | 48.94 | 22.92 | — | 45.4 | |
| LongT5Model Size=large, Input Length=4k, Attention=TGlobal2021.12 | 48.38 | 23.32 | — | 44.93 | |
| HAT-BART2021.12 | 48.36 | 21.43 | — | 37 | |
| T5.1.1Model Size=large, Input Length=4k2021.12 | 47.9 | 22.08 | — | 44.36 | |
| LongT5Model Size=base, Input Length=4k, Attention=TGlobal2021.12 | 47.77 | 22.58 | — | 44.38 | |
| Gold ExtType=Oracle2019.09 | 47.76 | 20.36 | 11.52 | 39.19 | |
| T5.1.1 + PSGModel Size=large, Input Length=2k2021.12 | 46.51 | 20.37 | — | 43 | |
| DANCER PEGASUS2021.12 | 46.34 | 19.97 | — | 42.42 | |
| DANCER2026.02 | 46.34 | 19.97 | — | 42.42 | |
| TLM-I+E (G,G)Type=Oracle2019.09 | 46.32 | 20.15 | 11.75 | 43.23 | |
| BIGBIRD-PegasusModel Category=Large2020.07 | 46.32 | 20.65 | — | 42.33 | |
| BigBird-PEGASUSModel Size=large2021.12 | 46.32 | 20.65 | — | 42.33 | |
| BigBird2026.02 | 46.32 | 20.65 | — | 42.33 | |
| PEGASUS_LARGEPre-training strategy=mixed, stochastic2019.12 | 45.97 | 20.15 | — | 28.25 | |
| PegasusModel Category=Large, Evaluation Source=Reported2020.07 | 45.97 | 20.15 | — | 41.34 | |
| T5.1.1Model Size=large, Input Length=2k2021.12 | 45.51 | 19.55 | — | 42.1 | |
| Sent-CLFType=Ext2019.09 | 45.01 | 19.91 | 12.13 | 41.16 | |
| Sent-CLFModel Category=Prior Art2020.07 | 45.01 | 19.91 | — | 41.16 | |
| PEGASUS2026.02 | 44.7 | 17.27 | — | 25.8 | |
| BART2026.02 | 44.61 | 19.37 | — | 41.01 | |
| PegasusModel Category=Large, Evaluation Source=Re-eval2020.07 | 44.53 | 19.3 | — | 40.7 | |
| DancerModel Category=Prior Art2020.07 | 44.09 | 17.69 | — | 40.27 | |
| BIGBIRD-ROBERTaModel Category=Base2020.07 | 43.7 | 19.32 | — | 39.99 | |
| T5.1.1 + PSGModel Size=large, Input Length=1k2021.12 | 43.34 | 17.55 | — | 40.1 | |
| Sent-PTRType=Ext2019.09 | 43.3 | 17.92 | 10.67 | 39.47 | |
| Sent-PTRModel Category=Prior Art2020.07 | 43.3 | 17.92 | — | 39.47 | |
| T5.1.1Model Size=large, Input Length=1k2021.12 | 42.18 | 16.6 | — | 38.96 | |
| TLM-I+E (G,M)Type=Mix2019.09 | 42.13 | 16.27 | 8.82 | 39.21 | |
| Extr-Abst-TLMModel Category=Prior Art2020.07 | 42.13 | 16.27 | — | 39.21 | |
| MatchSum2026.02 | 41.21 | 14.91 | — | 36.75 | |
| Transformer + PegasusModel Category=Base2020.07 | 39.98 | 15.15 | — | 35.89 | |
| LexRankCategory=Extractive2018.04 | 39.19 | 13.89 | 7.27 | 34.59 | |
| LexRankType=Ext2019.09 | 39.19 | 13.89 | 7.27 | 34.59 | |
| LexRankModel Category=Prior Art2020.07 | 39.19 | 13.89 | — | 34.59 | |
| Discourse-Aware Attention ModelCategory=Abstractive2018.04 | 38.93 | 15.37 | 9.97 | 35.21 | |
| DiscourseType=Mix2019.09 | 38.93 | 15.37 | 9.97 | 35.21 | |
| Long-Doc-Seq2SeqModel Category=Prior Art2020.07 | 38.93 | 15.37 | — | 35.21 | |
| TextRank2026.02 | 38.66 | 15.87 | — | 34.53 | |
| Fastformer2021.08 | 38.09 | 15.44 | — | 34.81 | |
| Poolingformer2021.08 | 37.82 | 15.15 | — | 34.63 | |
| BigBird2021.08 | 37.73 | 14.99 | — | 34.51 | |
| Lead-10Type=Ext2019.09 | 37.45 | 14.19 | 8.26 | 34.07 | |
| Linformer2021.08 | 37.22 | 14.48 | — | 34.02 | |
| SumBasicCategory=Extractive2018.04 | 37.15 | 11.36 | 5.42 | 33.43 | |
| SumBasicType=Ext2019.09 | 37.15 | 11.36 | 5.42 | 33.43 | |
| SumBasicModel Category=Prior Art2020.07 | 37.15 | 11.36 | — | 33.43 | |
| TLM-IType=Abs2019.09 | 37.06 | 11.69 | 5.31 | 34.27 | |
| Longformer2021.08 | 36.92 | 14.34 | — | 33.75 | |
| Linear Transformer2021.08 | 36.43 | 13.8 | — | 33.21 | |
| Pntr-Gen-Seq2SeqCategory=Abstractive2018.04 | 35.86 | 10.22 | 7.6 | 29.69 | |
| Pointer-genType=Mix2019.09 | 35.86 | 10.22 | 7.6 | 29.69 | |
| Pntr-Gen-Seq2SeqModel Category=Prior Art2020.07 | 35.86 | 10.22 | — | 29.69 | |
| Transformer + ROBERTAModel Category=Base2020.07 | 35.77 | 13.85 | — | 33.32 | |
| Transformer2021.08 | 34.26 | 11.88 | — | 31.64 | |
| LSACategory=Extractive2018.04 | 33.89 | 9.93 | 5.04 | 29.7 | |
| LSAType=Ext2019.09 | 33.89 | 9.93 | 5.04 | 29.7 | |
| LSAModel Category=Prior Art2020.07 | 33.89 | 9.93 | — | 29.7 | |
| TransformerModel Category=Base2020.07 | 31.71 | 8.32 | — | 29.42 | |
| Attn-Seq2SeqCategory=Abstractive2018.04 | 31.55 | 8.52 | 7.05 | 27.38 | |
| Seq2seqType=Abs2019.09 | 31.55 | 8.52 | 7.05 | 27.38 | |
| Attn-Seq2SeqModel Category=Prior Art2020.07 | 31.55 | 8.52 | — | 27.38 | |
| Lead-32026.02 | 26.38 | 8.73 | — | 16.6 |