Mathematical Reasoning on Minerva (pass@1, pass@256)
39.7pass@1Qwen2.5-7B-SimpleRL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-7B-SimpleRLZero-shot=true2025.05 | 39.7 | — | |
| Eurus-2-7B-PRIMEZero-shot=true2025.05 | 38.6 | — | |
| GRPOBackbone=Qwen2.5-7B, Group Size (N)=82026.02 | 36 | 60.2 | |
| F-GRPOBackbone=Qwen2.5-7B, Group Size (N)=82026.02 | 35.7 | 60.3 | |
| DAPOBackbone=Qwen2.5-7B, Group Size (N)=82026.02 | 35.5 | 61.2 | |
| Llama-3.1-70B-InstructZero-shot=true2025.05 | 35.3 | — | |
| F-DAPOBackbone=Qwen2.5-7B, Group Size (N)=82026.02 | 35 | 62.9 | |
| CISPOBackbone=Qwen2.5-7B, Group Size (N)=82026.02 | 34.7 | 63.3 | |
| F-CISPOBackbone=Qwen2.5-7B, Group Size (N)=82026.02 | 34.6 | 64.3 | |
| Qwen-2.5-Math-7B-InstructZero-shot=true2025.05 | 34.6 | — | |
| DAPOBackbone=Qwen2.5-1.5B-Math, Group Size (N)=82026.02 | 32.6 | 63.5 | |
| CISPOBackbone=Qwen2.5-1.5B-Math, Group Size (N)=82026.02 | 32.6 | 59.8 | |
| GRPO†Zero-shot=true, Fine-tuning Samples=7,0002025.05 | 32.4 | — | |
| DRA-GRPO (Ours)Zero-shot=true, Fine-tuning Samples=7,0002025.05 | 32.4 | — | |
| F-DAPOBackbone=Qwen2.5-1.5B-Math, Group Size (N)=82026.02 | 32.2 | 63.8 | |
| GRPOBackbone=Qwen2.5-1.5B-Math, Group Size (N)=82026.02 | 31.9 | 61.1 | |
| F-CISPOBackbone=Qwen2.5-1.5B-Math, Group Size (N)=82026.02 | 31.7 | 63.2 | |
| F-GRPOBackbone=Qwen2.5-1.5B-Math, Group Size (N)=82026.02 | 31 | 61 | |
| Open-RS2Zero-shot=true, Fine-tuning Samples=7,0002025.05 | 30.5 | — | |
| DR. GRPO†Zero-shot=true, Fine-tuning Samples=7,0002025.05 | 30.5 | — | |
| DRA-DR. GRPO (Ours)Zero-shot=true, Fine-tuning Samples=7,0002025.05 | 30.5 | — | |
| DeepScaleR-1.5B-PreviewZero-shot=true, Fine-tuning Samples=40,0002025.05 | 30.2 | — | |
| Still-3-1.5B-PreviewZero-shot=true, Fine-tuning Samples=30,0002025.05 | 29 | — | |
| Open-RS1Zero-shot=true, Fine-tuning Samples=18,6152025.05 | 29 | — | |
| Open-RS3Zero-shot=true, Fine-tuning Samples=7,0002025.05 | 26.8 | — | |
| DeepSeek-R1-Distill-Qwen-1.5BZero-shot=true, Fine-tuning Samples=Base Model2025.05 | 26.5 | — | |
| DAPOBackbone=Llama-3.2-3B-Instruct, Group Size (N)=82026.02 | 22.4 | 54.1 | |
| F-DAPOBackbone=Llama-3.2-3B-Instruct, Group Size (N)=82026.02 | 22.3 | 59.3 | |
| F-CISPOBackbone=Llama-3.2-3B-Instruct, Group Size (N)=82026.02 | 22.1 | 58.8 | |
| GRPOBackbone=Llama-3.2-3B-Instruct, Group Size (N)=82026.02 | 21.8 | 59 | |
| CISPOBackbone=Llama-3.2-3B-Instruct, Group Size (N)=82026.02 | 21.8 | 59.5 | |
| F-GRPOBackbone=Llama-3.2-3B-Instruct, Group Size (N)=82026.02 | 21 | 60.1 |