CNN/DM
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CNN/DM
76.2AUC
4
CNN/DM Low Consistency (score_cons < 0.73)
74.3Coverage
4
CNN/DM CNN (Low Coverage (score_cov < 0.60))
74Coverage
4
CNN/DM (All Summaries)
73.7Coverage
4
CNN/DM
20.5Hal. Rate
4
CNN/DM
99.46AUROC
4
CNN/DM (test)
44.05ROUGE-1
4
CNN/DM human evaluation
24Informational Content Score
4
CNN/DM Within AF (test)
59.2Pairwise Ranking Accuracy
4
CNN/DM All Pairs (test)
85.27Pairwise Ranking Accuracy
4
CNN/DM
14.33BERTScore F1
3
CNN-DM (test)
50.4Diversity Win Rate
3
CNN/DM
2.08Throughput
2