List your company
ResearchFormerly WizWand

Mathematical Reasoning on AQuA (Exact Match %)

79.92AQuA Exact MatchMin-k
-3.196818.381639.9661.5384Apr 13, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Min-kModel=Qwen3-4B-Instruct, Temperature=4.02026.0479.92
Min-kModel=Qwen3-4B-Instruct, Temperature=1.02026.0479.13
Min-kModel=Qwen3-4B-Instruct, Temperature=2.02026.0479.13
Min-kModel=Qwen3-4B-Instruct, Temperature=3.02026.0479.13
Min-kModel=Qwen3-4B-Instruct, Temperature=10.02026.0479.13
Top-nσModel=Qwen3-4B-Instruct, Temperature=1.02026.0478.35
Top-nσModel=Qwen3-4B-Instruct, Temperature=4.02026.0478.35
Min-kModel=Qwen3-4B-Instruct, Temperature=5.02026.0478.35
Top-pModel=Qwen3-4B-Instruct, Temperature=1.02026.0477.95
Top-kModel=Qwen3-4B-Instruct, Temperature=2.02026.0477.56
Min-pModel=Qwen3-4B-Instruct, Temperature=1.02026.0477.56
Top-pModel=Qwen3-4B-Instruct, Temperature=2.02026.0477.17
Top-nσModel=Qwen3-4B-Instruct, Temperature=2.02026.0477.17
Top-nσModel=Qwen3-4B-Instruct, Temperature=3.02026.0477.17
Top-nσModel=Qwen3-4B-Instruct, Temperature=5.02026.0477.17
Top-nσModel=Qwen3-4B-Instruct, Temperature=10.02026.0477.17
Min-pModel=Qwen3-4B-Instruct, Temperature=2.02026.0476.77
Top-kModel=Qwen3-4B-Instruct, Temperature=1.02026.0475.2
Min-pModel=Qwen3-4B-Instruct, Temperature=3.02026.0474.41
Top-kModel=Qwen3-4B-Instruct, Temperature=3.02026.0471.65
Top-pModel=Qwen3-4B-Instruct, Temperature=3.02026.0470.87
Min-pModel=Qwen3-4B-Instruct, Temperature=4.02026.0469.69
Top-kModel=Qwen3-4B-Instruct, Temperature=4.02026.0462.2
Min-pModel=Qwen3-4B-Instruct, Temperature=5.02026.0455.12
Min-kModel=LLaMA3-8B-Instruct, Temperature=4.02026.0452.76
Top-pModel=Qwen3-4B-Instruct, Temperature=4.02026.0452.76
Min-kModel=LLaMA3-8B-Instruct, Temperature=5.02026.0450.39
Min-pModel=LLaMA3-8B-Instruct, Temperature=1.02026.0450
Min-kModel=LLaMA3-8B-Instruct, Temperature=1.02026.0450
Top-pModel=LLaMA3-8B-Instruct, Temperature=1.02026.0449.61
Top-nσModel=LLaMA3-8B-Instruct, Temperature=10.02026.0449.61
Top-nσModel=LLaMA3-8B-Instruct, Temperature=1.02026.0448.03
Min-kModel=LLaMA3-8B-Instruct, Temperature=2.02026.0448.03
Top-nσModel=LLaMA3-8B-Instruct, Temperature=2.02026.0447.24
Top-kModel=LLaMA3-8B-Instruct, Temperature=1.02026.0446.85
Top-nσModel=LLaMA3-8B-Instruct, Temperature=3.02026.0446.06
Top-nσModel=LLaMA3-8B-Instruct, Temperature=4.02026.0446.06
Min-kModel=LLaMA3-8B-Instruct, Temperature=10.02026.0446.06
Top-nσModel=LLaMA3-8B-Instruct, Temperature=5.02026.0444.49
Min-kModel=LLaMA3-8B-Instruct, Temperature=3.02026.0444.49
Top-kModel=Qwen3-4B-Instruct, Temperature=5.02026.0444.09
Top-kModel=LLaMA3-8B-Instruct, Temperature=2.02026.0440.94
Min-pModel=LLaMA3-8B-Instruct, Temperature=2.02026.0432.68
Top-pModel=LLaMA3-8B-Instruct, Temperature=2.02026.0431.1
Min-pModel=LLaMA3-8B-Instruct, Temperature=3.02026.0424.02
Top-pModel=Qwen3-4B-Instruct, Temperature=5.02026.0419.29
Top-kModel=LLaMA3-8B-Instruct, Temperature=3.02026.0417.72
Top-pModel=LLaMA3-8B-Instruct, Temperature=3.02026.0412.99
Top-kModel=LLaMA3-8B-Instruct, Temperature=4.02026.048.66
Min-pModel=LLaMA3-8B-Instruct, Temperature=4.02026.047.48
Min-pModel=LLaMA3-8B-Instruct, Temperature=5.02026.047.08
Top-kModel=LLaMA3-8B-Instruct, Temperature=5.02026.046.69
Top-pModel=LLaMA3-8B-Instruct, Temperature=4.02026.043.54
Top-pModel=LLaMA3-8B-Instruct, Temperature=5.02026.041.18
Top-kModel=LLaMA3-8B-Instruct, Temperature=10.02026.040
Top-pModel=LLaMA3-8B-Instruct, Temperature=10.02026.040
Min-pModel=LLaMA3-8B-Instruct, Temperature=10.02026.040
Top-kModel=Qwen3-4B-Instruct, Temperature=10.02026.040
Top-pModel=Qwen3-4B-Instruct, Temperature=10.02026.040
Min-pModel=Qwen3-4B-Instruct, Temperature=10.02026.040