SummEval
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SUMMEVAL (test)
67.19Accuracy
8
SummEval (test)
0.043Test Risk (MSE)
7
SummEval
1.55Relevance (theta_ratio)
7
SummEval (test)
0.044MSE (Table)
6
SummEval (anchor set)
94.5Accuracy
6
SummEval
0.717AUROC
5
SummEval (test)
71.5Accuracy
5
SummEval
0.65Kendall's Tau
5
SummEval
46.9Accuracy
4
SummEval
49.5Accuracy
4
SummEval
0.535Kendall's tau (τ)
3
SummEval
0.474Avg Spearman Corr
3
SummEval
18.3Attribute Score (Before)
3