SAT
Benchmarks
TaskDatasetSOTA resultTrendResults
SAT
0.986Accuracy
56
SAT-Math
97.66SAT Math Accuracy
47
SAT-Real
93.9AVG
41
SAT
98.2Accuracy
35
SAT Real
75.3Accuracy (Pass@1)
25
SAT
88Score
23
SAT
83.3Overall Acc
21
SAT-6 (test)
99.84Accuracy
21
SAT
97.6Accuracy (SAT)
17
SAT
92Accuracy
17
SAT
79F1 Score
16
SAT6
96.75Accuracy
16
sat
-0.007Bias
15
SAT (synthesized)
95.4EgoM
15
SAT
60.78Accuracy
15
SAT
92Score
14
SAT
76.7Accuracy
14
SAT
76Accuracy
13
SAT Real
84.1Accuracy
13
SAT
87.7Val Metric Score
12
SAT
73.3Accuracy
11
SAT ood (test)
79.7Accuracy
11
SAT (test)
91Accuracy
11
SAT
0.91Accuracy
11
SAT
59.49Accuracy
10