GSM8K
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GSM8K
95.6Score
8
GSM8K (test)
9.61Pass Rate @8
8
GSM8K
78.8Accuracy
8
GSM8K
91.4T (Success Rate)
8
GSM8K
0.898AUROC
8
GSM8K
81.2Accuracy
8
GSM8K benign prompts
0False Positive Rate
8
GSM8K
88.7Nec
8
GSM8K
100Accuracy
8
GSM8K
100Accuracy
8
GSM8K
80.82Accuracy
8
GSM8k Tensor-2 (test)
49.2Accuracy
8
GSM8k Base-7 (test)
49.9Accuracy
8
GSM8K (test)
1.84SG Score
8
GSM8K
12.37Throughput
8
GSM8K
47.56Accuracy
8
GSM8K s (subsampled 2500)
96Accuracy
8
GSM8K
19.99TTFT (ms)
8
GSM8K zero-shot
77.6Accuracy
8
GSM8K
79.92Accuracy
8
GSM8K
0.928Avg@16 Accuracy
8
GSM8K
2.71Speedup
8
GSM8K (evaluation)
93.3Accuracy
8
GSM8K
89Accuracy
8
GSM8K
53Comparable SC Rate
8