Mathematical Reasoning on MATH 500 (Accuracy, Drop, TC2b)
93AccuracyQwen3-32B (FP16)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-32B (FP16)Model=Qwen3-32B, Precision=FP162026.06 | 93 | — | — | |
| Qwen3-8B (FP16)Model=Qwen3-8B, Precision=FP162026.06 | 92.4 | — | — | |
| Qwen3-32B (+P + L)Model=Qwen3-32B, Precision=2-bit + FP16 plan + loop rescue2026.06 | 87.2 | -28 | 84.2 | |
| Qwen3-32B (+P)Model=Qwen3-32B, Precision=2-bit + FP16 plan2026.06 | 80.6 | -28 | 84.2 | |
| Qwen3-8B (+P + L)Model=Qwen3-8B, Precision=2-bit + FP16 plan + loop rescue2026.06 | 76.2 | -75.2 | 23.6 | |
| Qwen3-8B (+L)Model=Qwen3-8B, Precision=2-bit + loop rescue2026.06 | 74.2 | -75.2 | 23.6 | |
| Qwen3-32B (+L)Model=Qwen3-32B, Precision=2-bit + loop rescue2026.06 | 73.2 | -28 | 84.2 | |
| Qwen3-32B (2bit)Model=Qwen3-32B, Precision=2-bit2026.06 | 65 | -28 | 84.2 | |
| Qwen3-8B (+P)Model=Qwen3-8B, Precision=2-bit + FP16 plan2026.06 | 26.4 | -75.2 | 23.6 | |
| Qwen3-8B (2bit)Model=Qwen3-8B, Precision=2-bit2026.06 | 17.2 | -75.2 | 23.6 |