Mathematics on AIME 24 (pass@1)
53.75Pass@1INSIGHT
Evaluation results
| Method | Links | |
|---|---|---|
| INSIGHTModel=QWEN3-4B2026.03 | 53.75 | |
| INVERSE-EVIDENCEModel=QWEN3-4B2026.03 | 52.22 | |
| RANDOMModel=QWEN3-4B2026.03 | 51.45 | |
| DSModel=R1-DISTILL-QWEN-7B2026.03 | 50.62 | |
| MoPPSModel=QWEN3-4B2026.03 | 50 | |
| INSIGHTModel=R1-DISTILL-QWEN-7B2026.03 | 47.71 | |
| EXPECTED-DIFFICULTYModel=R1-DISTILL-QWEN-7B2026.03 | 47.5 | |
| MoPPSModel=R1-DISTILL-QWEN-7B2026.03 | 47.2 | |
| INVERSE-EVIDENCEModel=R1-DISTILL-QWEN-7B2026.03 | 47 | |
| RANDOMModel=R1-DISTILL-QWEN-7B2026.03 | 46.25 | |
| Scaf-GRPOBase Model=Qwen2.5-Math-7B2025.10 | 43.3 | |
| LUFFYBase Model=Qwen2.5-Math-7B2025.10 | 33.3 | |
| Scaf-GRPOBase Model=DeepSeek-R1-Distill-Qwen-1.5B2025.10 | 33.3 | |
| Vanilla GRPOBase Model=Qwen2.5-Math-7B2025.10 | 30 | |
| Oat-ZeroBase Model=Qwen2.5-Math-7B2025.10 | 30 | |
| Vanilla GRPOBase Model=DeepSeek-R1-Distill-Qwen-1.5B2025.10 | 30 | |
| DeepSeek-R1-Distill-Qwen-1.5BBase Model=DeepSeek-R1-Distill-Qwen-1.5B2025.10 | 28.9 | |
| SimpleRL-ZeroBase Model=Qwen2.5-Math-7B2025.10 | 23.3 | |
| Scaf-GRPOBase Model=Qwen2.5-Math-1.5B2025.10 | 20 | |
| Scaf-GRPOBase Model=Llama-3.2-3B-Instruct2025.10 | 16.7 | |
| Vanilla GRPOBase Model=Qwen2.5-Math-1.5B2025.10 | 13.3 | |
| Qwen2.5-Math-7BBase Model=Qwen2.5-Math-7B2025.10 | 13.3 | |
| Scaf-GRPOBase Model=Qwen2.5-7B2025.10 | 13.3 | |
| Vanilla GRPOBase Model=Llama-3.2-3B-Instruct2025.10 | 13.3 | |
| INSIGHTModel=QWEN3-0.6B2026.03 | 11.9 | |
| MoPPSModel=QWEN3-0.6B2026.03 | 10.83 | |
| INVERSE-EVIDENCEModel=QWEN3-0.6B2026.03 | 10.6 | |
| RANDOMModel=QWEN3-0.6B2026.03 | 10.41 | |
| Qwen2.5-7BBase Model=Qwen2.5-7B2025.10 | 10 | |
| Vanilla GRPOBase Model=Qwen2.5-7B2025.10 | 10 | |
| Qwen2.5-Math-1.5BBase Model=Qwen2.5-Math-1.5B2025.10 | 7.2 | |
| Llama-3.2-3B-InstructBase Model=Llama-3.2-3B-Instruct2025.10 | 6.7 |