CNN/DM
Benchmarks
TaskDatasetSOTA resultTrendResults
CNN/DM
35.8ROUGE-1 F1
80
CNN/DM
56.22ROUGE-1
56
CNN-DM
0.974AUC
36
CNN/DM
10.64M Score
35
CNN/DM
4.23MAT
34
CNN/DM
3.58Speedup
32
CNN/DM
6.51MAT Score
30
CNN/DM (test)
27.42FRE Delta
25
CNN/DM
51.85ROUGE-1
21
CNN/DM
217.02TPS Score
20
CNN/DM
2.08Speedup (vs AR)
19
CNN/DM
37.52ROUGE-L
18
CNN/DM
1.9Spd Score
18
CNN/DM (test)
52.59ROUGE-1
18
CNN/DM 55w 1,000 samples (test)
35.8ROUGE-1 F1
16
CNN/DM
16.95ROUGE-2
16
CNN-DM
149.33Context Influence
15
CNN/DM
76.14AUROC
14
CNN/DM
99.89AUROC
14
CNN/DM
42.05ROUGE-1
14
CNN/DM
44.59ROUGE-1
13
CNN DM
50.17TPS
13
CNN/DM random subset of 10,000 samples
1.129Log-Probability Drop
12
CNN/DM
52.85SummaC
12
CNN/DM sampled (test)
22.86ROUGE Score
12