List your company
ResearchFormerly WizWand

Extractive Summarization on PubMed (test)

61.49ROUGE-1ORACLE
36.176442.748249.3255.8918Apr 19, 2020Jan 9, 2021Oct 1, 2021Jun 24, 2022Mar 16, 2023Dec 6, 2023Aug 28, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ORACLEModel Type=Extractive2024.0861.4934.755.92
Oracle2020.1155.0527.4849.11
EYEGLAXSBackbone=LLAMA2-7B, Sequence Length=12K2024.0850.3424.5745.96
Long-T5Model Type=Abstractive2024.0850.2324.7646.67
EYEGLAXSBackbone=CHATGLM2-6B, Sequence Length=12K2024.0850.1724.4145.66
EYEGLAXSBackbone=CHATGLM2-6B, Sequence Length=4K2024.0849.9624.0445.5
GoSumModel Type=Extractive2024.0849.8323.5645.1
EYEGLAXSBackbone=LLAMA2-7B, Sequence Length=4K2024.0849.4823.6445.08
Lodoss-full-LGModel Type=Extractive2024.0849.3823.8944.84
Lodoss-baseBackbone=Longformer, Model Type=Extractive2024.0848.122.5343.51
Histruct+Model Type=Extractive2024.0846.5920.3942.11
Bigbird-largeModel Type=Abstractive2024.0846.3220.6542.33
MMR-Select+Category=C, Base Model=ExtSum-LG2020.1145.3920.3740.99
RdLossCategory=B, Base Model=ExtSum-LG2020.1145.320.4240.95
MMR-SelectCategory=C, Base Model=ExtSum-LG2020.1145.2920.340.9
ExtSum-LG2020.1145.1820.240.72
SR DecoderCategory=A, Base Model=ExtSum-LG2020.1145.1820.1640.69
ORACLE2020.0445.1220.3340.19
Sent-PTRModel Type=Extractive2024.0845.0119.9141.16
NeuSum DecoderCategory=A, Base Model=ExtSum-LG2020.1144.5419.6640.42
Trigram BlockingCategory=C, Base Model=ExtSum-LG2020.1143.3317.6739.01
MATCH-ORACLE2020.0442.2115.4237.67
GenCompareSumModel Type=Extractive2024.0842.116.5138.25
MATCHSUMBackbone=BERT-base2020.0441.2114.9136.75
BERTEXT2020.0441.0514.8836.57
BERTEXTNgram Blocking=4gram2020.0440.2914.3735.88
LexRankModel Type=Extractive2024.0839.1913.8934.59
BERTEXTNgram Blocking=3gram2020.0438.8113.6234.52
LEAD2020.0437.5812.2233.11
Naive MMRCategory=C2020.1137.4611.2532.22
LEAD-10Model Type=Extractive2024.0837.4514.1934.07
SumBasicModel Type=Extractive2024.0837.1511.3633.43