Mathematics Problem Solving on MATH500 (test)
61.2Exact Match AccuracyTop-k
Evaluation Results
| Method | Links | |
|---|---|---|
| Top-kModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 61.2 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 61.2 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 61 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 60.6 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 60 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 60 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 59.8 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 59.8 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=1.02026.04 | 59.4 | |
| Min-kModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 59.4 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 59.2 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 59.2 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 59 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 58.8 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 58.8 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=2.02026.04 | 58 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 58 | |
| Top-nσModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 57.8 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 57 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 53.4 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=3.02026.04 | 53 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 49 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 46.4 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 46.4 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 44.4 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 44.2 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 44 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 43.8 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 43.6 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=1.02026.04 | 43.4 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 43.4 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 43.2 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 43.2 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 43 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 42.4 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 42.2 | |
| Top-nσModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 41.8 | |
| Min-kModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 41.4 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 40.6 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 36.8 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=2.02026.04 | 35.6 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=4.02026.04 | 29.8 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 29.4 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 21.4 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 15.8 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=3.02026.04 | 12.2 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 12.2 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 10.2 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 3.4 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=5.02026.04 | 2.4 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 1.4 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 1.4 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=4.02026.04 | 0.6 | |
| Top-kModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=5.02026.04 | 0 | |
| Top-pModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 0 | |
| Min-pModel=LLaMA3-70B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-kModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 0 | |
| Min-pModel=Qwen3-30B-Instruct, Temperature=10.02026.04 | 0 |