Mathematical Reasoning on AIME 24 (Accuracy, Pass@8)
70AccuracyQwen3-8B (Thinking)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-8B (Thinking)Model=Qwen3-8B, Variant=Thinking2026.05 | 70 | 83.3 | |
| Qwen3-1.7B + Guided (ρ¯ ≈ 0.16)Model=Qwen3-1.7B, Intervention Rate (rho)=≈ 0.162026.05 | 45 | 73.3 | |
| Qwen3-1.7B (Thinking)Model=Qwen3-1.7B, Variant=Thinking2026.05 | 39.2 | 73.3 | |
| Qwen3-0.6B + Guided (ρ¯ ≈ 0.13)Model=Qwen3-0.6B, Intervention Rate (rho)=≈ 0.132026.05 | 32.5 | 70 | |
| Qwen3-1.7B + Guided (ρ¯ ≈ 0.06)Model=Qwen3-1.7B, Intervention Rate (rho)=≈ 0.062026.05 | 20.4 | 46.7 | |
| Qwen3-0.6B + Guided (ρ¯ ≈ 0.04)Model=Qwen3-0.6B, Intervention Rate (rho)=≈ 0.042026.05 | 10 | 36.7 | |
| Qwen3-0.6B (Thinking)Model=Qwen3-0.6B, Variant=Thinking2026.05 | 9.2 | 30 | |
| Qwen3-1.7B-BaseModel=Qwen3-1.7B, Variant=Base2026.05 | 5 | 20 | |
| Qwen3-0.6B-BaseModel=Qwen3-0.6B, Variant=Base2026.05 | 0.4 | 3.3 |