Mathematical Reasoning on AIME 24 (pass@1, maj@16, pass@16)
19.6Pass@1DiRL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DiRLBase Model=Qwen3-4B-Base2026.06 | 19.6 | 26.4 | 44 | |
| G2RLBase Model=Qwen3-4B-Base2026.06 | 17 | 25.4 | 40.5 | |
| EVOL-RLBase Model=Qwen3-4B-Base2026.06 | 14.4 | 20.9 | 35.7 | |
| Entropy BonusBase Model=Qwen3-4B-Base2026.06 | 13.8 | 22.2 | 36.3 | |
| GRPOBase Model=Qwen3-4B-Base2026.06 | 12.3 | 19.8 | 32.5 | |
| DiRLBase Model=Qwen3-1.7B-Base2026.06 | 10.9 | 18.2 | 29.7 | |
| G2RLBase Model=Qwen3-1.7B-Base2026.06 | 9.7 | 17.4 | 27.4 | |
| Entropy BonusBase Model=Qwen3-1.7B-Base2026.06 | 7.6 | 12.6 | 26.6 | |
| EVOL-RLBase Model=Qwen3-1.7B-Base2026.06 | 6.9 | 13.5 | 24.5 | |
| GRPOBase Model=Qwen3-1.7B-Base2026.06 | 6.5 | 12.9 | 25.3 |