Mathematical Reasoning on MATH 500 (Exact Match %)
60.6Exact MatchTop-p
Evaluation Results
| Method | Links | |
|---|---|---|
| Top-pModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 60.6 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 60.6 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 60.4 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 60 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 59.8 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 59.4 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 59.2 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 59.2 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 59 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 58.8 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 58.8 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 58.8 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 58.8 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 57.8 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 57.6 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 57.4 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 57.4 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 57.2 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 55.4 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 55.2 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 50 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 48.8 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 42.6 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 33.2 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 29.2 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 25 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 24.6 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 24 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 23.4 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 23 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 22 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 22 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 22 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 22 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 21.8 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 21.6 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 21.4 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 21.2 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 20.4 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 20.2 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 17.6 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 13.4 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 11.6 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 9.2 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 7.2 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 3.4 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 2.2 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 0.6 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 0.2 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 0 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 0 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 0 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 0 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 0 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 0 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 0 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 0 |