Summarization on PubMed benchmark leaderboard · SOTA2 Research

Summarization on PubMed

50.23ROUGE-1LongT5

Evaluation Results

Method	Links
LongT52021.12		50.23	24.76	—	46.67
LongT52021.12		50.04	24.45	—	46.42
LongT52021.12		49.98	24.69	—	46.46
LongT52021.12		49.81	24.3	—	46.26
GloSA-sum2026.02		49.5	22.5	—	44.5
MemSum2026.02		49.14	22.92	—	44.33
BERTSum2026.02		49.1	24.3	—	25.7
LongT52021.12		48.99	23.48	—	45.51
T5.1.1 + PSG2021.12		48.94	22.92	—	45.4
LongT52021.12		48.38	23.32	—	44.93
HAT-BART2021.12		48.36	21.43	—	37
T5.1.12021.12		47.9	22.08	—	44.36
LongT52021.12		47.77	22.58	—	44.38
Gold Ext2019.09		47.76	20.36	11.52	39.19
T5.1.1 + PSG2021.12		46.51	20.37	—	43
DANCER PEGASUS2021.12		46.34	19.97	—	42.42
DANCER2026.02		46.34	19.97	—	42.42
TLM-I+E (G,G)2019.09		46.32	20.15	11.75	43.23
BIGBIRD-Pegasus2020.07		46.32	20.65	—	42.33
BigBird-PEGASUS2021.12		46.32	20.65	—	42.33
BigBird2026.02		46.32	20.65	—	42.33
PEGASUS_LARGE2019.12		45.97	20.15	—	28.25
Pegasus2020.07		45.97	20.15	—	41.34
T5.1.12021.12		45.51	19.55	—	42.1
Sent-CLF2019.09		45.01	19.91	12.13	41.16
Sent-CLF2020.07		45.01	19.91	—	41.16
PEGASUS2026.02		44.7	17.27	—	25.8
BART2026.02		44.61	19.37	—	41.01
Pegasus2020.07		44.53	19.3	—	40.7
Dancer2020.07		44.09	17.69	—	40.27
BIGBIRD-ROBERTa2020.07		43.7	19.32	—	39.99
T5.1.1 + PSG2021.12		43.34	17.55	—	40.1
Sent-PTR2019.09		43.3	17.92	10.67	39.47
Sent-PTR2020.07		43.3	17.92	—	39.47
T5.1.12021.12		42.18	16.6	—	38.96
TLM-I+E (G,M)2019.09		42.13	16.27	8.82	39.21
Extr-Abst-TLM2020.07		42.13	16.27	—	39.21
MatchSum2026.02		41.21	14.91	—	36.75
Transformer + Pegasus2020.07		39.98	15.15	—	35.89
LexRank2018.04		39.19	13.89	7.27	34.59
LexRank2019.09		39.19	13.89	7.27	34.59
LexRank2020.07		39.19	13.89	—	34.59
Discourse-Aware Attention Model2018.04		38.93	15.37	9.97	35.21
Discourse2019.09		38.93	15.37	9.97	35.21
Long-Doc-Seq2Seq2020.07		38.93	15.37	—	35.21
TextRank2026.02		38.66	15.87	—	34.53
Fastformer2021.08		38.09	15.44	—	34.81
Poolingformer2021.08		37.82	15.15	—	34.63
BigBird2021.08		37.73	14.99	—	34.51
Lead-102019.09		37.45	14.19	8.26	34.07
Linformer2021.08		37.22	14.48	—	34.02
SumBasic2018.04		37.15	11.36	5.42	33.43
SumBasic2019.09		37.15	11.36	5.42	33.43
SumBasic2020.07		37.15	11.36	—	33.43
TLM-I2019.09		37.06	11.69	5.31	34.27
Longformer2021.08		36.92	14.34	—	33.75
Linear Transformer2021.08		36.43	13.8	—	33.21
Pntr-Gen-Seq2Seq2018.04		35.86	10.22	7.6	29.69
Pointer-gen2019.09		35.86	10.22	7.6	29.69
Pntr-Gen-Seq2Seq2020.07		35.86	10.22	—	29.69
Transformer + ROBERTA2020.07		35.77	13.85	—	33.32
Transformer2021.08		34.26	11.88	—	31.64
LSA2018.04		33.89	9.93	5.04	29.7
LSA2019.09		33.89	9.93	5.04	29.7
LSA2020.07		33.89	9.93	—	29.7
Transformer2020.07		31.71	8.32	—	29.42
Attn-Seq2Seq2018.04		31.55	8.52	7.05	27.38
Seq2seq2019.09		31.55	8.52	7.05	27.38
Attn-Seq2Seq2020.07		31.55	8.52	—	27.38
Lead-32026.02		26.38	8.73	—	16.6