GSM8K
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8K
94Accuracy
4
GSM8K (test)
57.1GSM8K Score
4
GSM8K
8.58Throughput (tokens/s)
4
GSM8K
77.2Accuracy
4
GSM8K (test)
1.16RAvg
4
GSM8k
0.642BCE
4
GSM8k 5-shot
89.47Throughput
4
GSM8K zero-shot
86.9Accuracy
4
GSM8K
82.03ACC
4
GSM8K first 300 examples (test)
43Accuracy
4
GSM8K (test)
80.97Accuracy
4
GSM8K Zero (test)
78.43Accuracy
4
GSM8K
78.4HS
4
GSM8K
14.48Accuracy
4
GSM8K (train)
98.9Rationale Validity Rate
4
GSM8k (dev)
84.1Execution Accuracy
4
GSM8K-Python (test)
51.3Pass@1
4
GSM8K
64.22Exact Match (EM)
3
GSM8K 100 (pilot)
90Accuracy
3
GSM8K (test)
90.07Accuracy
3
GSM8K
0.48Drift |δ|
3
GSM8K
92.6Exact Match (EM)
3
GSM8K
0.742Accuracy
3
GSM8K 60 (test)
0.994AUROC
3
GSM8K
0.602Kendall's Tau Correlation
3