SumMe
Benchmarks
TaskDatasetSOTA resultTrendResults
SumMe
64.2F1 Score (Avg)
130
SumMe (TVT)
0.282Kendall's Tau
44
SumMe (various)
53.4F-score
35
SumMe
0.282Kendall's tau
35
SumMe (test)
57.1F-score
35
SumMe (Augmented)
52.1F-score
33
SumMe
0.253Kendall's τ
32
SumMe unsupervised
51.7F-score
20
SumMe 5FCV (traditional train val (TV))
0.282Kendall's Tau
19
SumMe single ground truth (test)
65.9F1 Score
17
SumMe (Transfer)
46.4F-score
16
SumMe (5FCV)
0.256Kendall's Tau
14
SumMe
0.55CC
13
SumMe
58.3F-Score
13
SumMe (5-fold cross-validation)
54.3F1 Score
12
SumMe (TV)
0.282Kendall's Tau
9
SumMe (test)
0.47PLCC
9
SumMe
1Rank
8
SumMe canonical (train test)
0.604F1 Score
8
SumMe (test)
0.471CC
7
SumMe (original five splits)
0.545F1 Score
6
SumMe
57.5F1 Score
4