SLAKE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SLAKE
90.62Accuracy
289
SLAKE Open 1.0 (test)
2.6ECE
96
SLAKE Closed 1.0 (test)
0ECE
96
SLAKE Open
45.2ACE
96
SLAKE Closed
36.7ACE
96
SLAKE (test)
91.8Closed Accuracy
82
SLAKE closed-end
92.39Accuracy
54
SLAKE (All)
78.91AUC
37
SLAKE Open-Ended
79.94AUC
37
SLAKE
90.7Closed Accuracy
35
SLAKE
93.27Closed Score
33
SLAKE
90.62Accuracy
30
Slake
91.1Closed Accuracy
27
SLAKE Open
89.9Token Recall
26
SLAKE Open
86.85Accuracy
26
SLAKE
71.55Accuracy
25
SLAKE
71.9AUC
20
SLAKE (test)
74.7Accuracy
20
SLAKE
84.7Accuracy
18
SLAKE-CP
30.2Open Score
18
SLAKE Closed
73.2AUROC
17
slake
14.06ECE
16
SLAKE
64.92Accuracy
14
Slake 12
88.4F1
14
SLAKE Closed
93.2Accuracy
11