ASDIV
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ASDiv
0.955Accuracy
280
ASDiv
93.74Accuracy
69
ASDiv (test)
97.24Accuracy
62
ASDiv
95.3Pass@1
51
ASDiv Out of Distribution
89.1Top-1 Accuracy (maj@1)
35
ASDiv Aug
94.02Accuracy
33
ASDiv Aug (test)
88.9Accuracy
25
ASDiv
66.91AUROC
20
ASDiv
96.74Accuracy
18
ASDiv-Aug
92.14Accuracy
15
ASDiv
96.58Accuracy
14
ASDiv (held-out)
75.52Performance
14
ASDiv A (test)
91Accuracy
14
Asdiv
78.79Score
12
ASDiv
99.2Accuracy
8
ASDiv
99.2Accuracy
8
ASDiv-A (5-fold cross-val)
87.5Accuracy
7
ASDiv
81.4Accuracy (pass@1)
6
ASDiv
0.682AUROC
6
ASDiv
66.91AUROC
6
ASDIV
79.6Solve Rate
6
ASDiv (5-fold cross val)
73.9Accuracy
3
ASDiv numeric-1000
78.4Initial Accuracy
2
ASDiv
78.4Initial Accuracy
1