SciTLDR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SCITLDR (dev)
0.072smECE
21
SCITLDR (dev)
0.08smECE
21
SciTLDR 1.0 (test)
52.4ROUGE-1
20
SciTLDR (test)
47.7ROUGE-1
14
SciTLDR (test)
0.88BERTScore
11
SciTLDR
0.783BERTScore
10
SciTLDR (test)
35.99RL Score
10
SCITLDR (dev)
0.08smECE
9
SciTLDR AIC
44.9ROUGE-1
8
SciTLDR Abstracts
43.8ROUGE-1
8
SciTLDR Full Text
36.92ROUGE-1
6
SciTLDR (test)
44.9ROUGE-1 F1
4
SciTLDR 76 gold papers
0.6MRR
4
SciTLDR AIC (test)
32.1Mean ROUGE-1
4