CNN/Daily Mail
Benchmarks
TaskDatasetSOTA resultTrendResults
CNN/Daily Mail (test)
50.77ROUGE-L
169
CNN/Daily Mail (test)
38.42ROUGE-2
77
CNN Daily Mail
47.97ROUGE-1
67
CNN/Daily Mail (test)
83COH Score
64
CNN/Daily Mail original, non-anonymized (test)
41.69ROUGE-1
54
CNN/Daily Mail non-anonymous (test)
44.16ROUGE-1
52
CNN/Daily Mail (test)
58ROUGE-1
36
CNN Daily Mail (test)
16.84Perplexity
28
CNN/Daily Mail (test)
3.382Speedup Ratio
26
CNN-Daily Mail
53.48Gecko Score
18
CNN/Daily Mail full length (test)
43.25ROUGE-1
18
CNN/Daily Mail 19 (test)
1.45Speedup (x)
15
CNN/Daily Mail anonymized (test)
40.13ROUGE-1
15
CNN/Daily Mail
2.31SR
12
CNN/Daily Mail
98.3Diversity
11
CNN/Daily Mail anonymized (test)
41.69ROUGE-1
11
CNN/Daily Mail
156.35Decoding Speed (tokens/s)
10
CNN Daily Mail
0.585Cosine Similarity
9
CNN/Daily Mail (test)
66Relevance
8
CNN/Daily Mail Original and Anonymized (test)
40.34ROUGE-1
8
CNN/Daily Mail (test)
39ROUGE-1
5
CNN/Daily Mail full-text (test)
49.97NN Score (2)
5
CNN/Daily Mail (OOD)
37.1ROUGE-1
4
CNN/Daily Mail
90.5Win Rate
3