Mathematical Reasoning on AIME 2024 (Avg@10 Accuracy)
39.33Avg@10 AccuracyAsymGRPO
Evaluation Results
| Method | Links | |
|---|---|---|
| AsymGRPOBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 39.33 | |
| GRPO w/ Entro.RegularizationBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 38.33 | |
| Dr.GRPOBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 36.33 | |
| GRPO w/ Clip-higherBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 34.67 | |
| AsymGRPO w/ Clip-higherBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 33.67 | |
| GRPO w/ Entro.AdvBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 32 | |
| AsymGRPO (βpos = βneg)Base Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 32 | |
| GRPOBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 31 | |
| REINFORCEBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 28.67 | |
| Pass@K TrainingBase Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 27.67 | |
| Pos-Only Modulation (§ 3.1)Base Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 27.33 | |
| Neg-Only Modulation (§ 3.1)Base Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 26 | |
| EntIncrease (§ 3.2)Base Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 26 | |
| EntDecrease (§ 3.2)Base Model=Qwen3-4B, Temperature=0.4, Top-p=1.02026.04 | 25 | |
| Qwen3-4BTemperature=0.4, Top-p=1.02026.04 | 21.67 |