Mathematical Reasoning on GSM8K (test) (Exact Match %)
95.83Exact Match Accuracy (GSM8K Test)Top-k
Evaluation Results
| Method | Links | |
|---|---|---|
| Top-kModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 95.83 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 95.68 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 95.6 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 95.6 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 95.6 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 95.6 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 95.6 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 95.45 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 95.45 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 95.37 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 95.37 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 95.37 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 95.3 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 95.15 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 95.07 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 95 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 95 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 94.92 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 94.69 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 94.62 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 94.01 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 93.25 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 92.95 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 92.95 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 92.95 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 92.95 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 92.87 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 92.87 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 92.79 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 92.65 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 92.64 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 92.57 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 92.49 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 92.42 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 92.34 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 92.04 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 91.96 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 91.89 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 91.66 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 91.13 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 89.46 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 87.95 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 84.69 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 81.2 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 77.56 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 64.22 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 62.02 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 58.98 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 52.34 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 36.92 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 20.77 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 9.63 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 8.57 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 0.83 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 0.45 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 0 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 0 |