SamSum
Benchmarks
TaskDatasetSOTA resultTrendResults
SAMSum (test)
33ROUGE-2
83
SAMSum
28.97ROUGE-2
73
SamSum
-0.113PRR
66
SamSum
82.1ROC-AUC
66
SAMSum (test)
52.7ROUGE-L
53
SAMSum
41.62Score
40
SAMSum LongBench
43.57ROUGE-L
30
SAMSum
27.2ROUGE Score
30
SAMSum Full 2019
37F1 Score
30
SAMSum
91.3BERTScore F1
30
SAMSum
46.7Spearman Correlation
30
Samsum
39.7BRT Accuracy
26
SamSum (test)
44.6Pearson Correlation Coefficient
22
SamSum
6.435HPI
22
SAMSum
32.9PRR
20
SAMSum
89.5AlignScore
19
SAMSum
6,581.55Prefill (tokens/s)
18
SamSum (test)
53.4ROUGE-1
18
SamSum
48.6PRR (ROUGE-L)
14
SAMSum
31.18Perplexity
13
SAMSum
41.08SummaC
12
SAMSum sampled (test)
26.88ROUGE Score
12
SAMSum (test)
29.58SummaC
12
SAMSum
4.98Completeness
12
SAMSum
31.46ROUGE-L
12