GSM8K
Benchmarks
TaskDatasetSOTA resultTrendResults
GSM8K
88.34Accuracy (%)
12
GSM8K
97.82Verifiability Score
12
GSM8K
94.68Reusability Score
12
GSM8K (test)
96Accuracy
12
GSM8K
0.796Accuracy
12
GSM8K
92.3Accuracy
12
GSM8K
89.6Avg@3 Score
12
GSM8K 128 samples
96.2Top-1 Accuracy
12
GSM8K
5.15Speedup
12
GSM8K
85.8AUC (%)
12
GSM8K (test)
95.7Pass@1
12
GSM8K (test)
82.8Accuracy
12
GSM8K
90.9Accuracy
12
GSM8K
28.2GSM8K Accuracy
11
GSM8K (test)
84.99Accuracy
11
GSM8K matched-N groups (test)
96.33Accuracy
11
GSM8K
1.64ECE
11
GSM8K
4.33Brier Score
11
GSM8K (test)
76.85Accuracy
11
GSM8K LONGGENBENCH
92.1Accuracy (n=15)
11
GSM8K-Aug (test)
57Accuracy
11
GSM8K
0.186Somers' D
11
GSM8K
70.17AUROC
11
GSM8K
94.97Solve Rate
11
GSM8K
94.49Accuracy
11