Mathematical Reasoning on AQuA (Exact Match %)
79.92AQuA Exact MatchMin-k
Evaluation Results
| Method | Links | |
|---|---|---|
| Min-kModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 79.92 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 79.13 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 79.13 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 79.13 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 79.13 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 78.35 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 78.35 | |
| Min-kModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 78.35 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 77.95 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 77.56 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 77.56 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 77.17 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 77.17 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 77.17 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 77.17 | |
| Top-nσModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 77.17 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=2.02026.04 | 76.77 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=1.02026.04 | 75.2 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 74.41 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 71.65 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=3.02026.04 | 70.87 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 69.69 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 62.2 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 55.12 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 52.76 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=4.02026.04 | 52.76 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 50.39 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 50 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 50 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 49.61 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 49.61 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 48.03 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 48.03 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 47.24 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=1.02026.04 | 46.85 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 46.06 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 46.06 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 46.06 | |
| Top-nσModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 44.49 | |
| Min-kModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 44.49 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 44.09 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 40.94 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 32.68 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=2.02026.04 | 31.1 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 24.02 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=5.02026.04 | 19.29 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 17.72 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=3.02026.04 | 12.99 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 8.66 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 7.48 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 7.08 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 6.69 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=4.02026.04 | 3.54 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=5.02026.04 | 1.18 | |
| Top-kModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 0 | |
| Min-pModel=LLaMA3-8B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-kModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 0 | |
| Top-pModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 0 | |
| Min-pModel=Qwen3-4B-Instruct, Temperature=10.02026.04 | 0 |