Math Problem Solving on MMATH (test)
27.1Accuracy (Ar)Qwen2.5-7B-Instruct + Vanilla GRPO
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-7B-Instruct + Vanilla GRPOMethod Extension=Vanilla GRPO2026.05 | 27.1 | 27.4 | 31.6 | 25.5 | 28.3 | 31.1 | 28.5 | 28.7 | 31.3 | 27.9 | 30.2 | 29.5 | 28.9 | |
| Qwen2.5-7B-Instruct + LANGMethod Extension=LANG2026.05 | 26.5 | 28.6 | 31.2 | 28.2 | 28.4 | 32.1 | 29.2 | 30.1 | 25.2 | 32.4 | 31.3 | 29.8 | 29.4 | |
| Qwen2.5-7B-Instruct + mGRPOMethod Extension=mGRPO2026.05 | 24.7 | 20.5 | 27.8 | 26.5 | 26 | 31 | 26.1 | 25.9 | 25 | 29.9 | 28.6 | 27.3 | 26.6 | |
| Qwen2.5-7B-Instruct + LC-GRPOMethod Extension=LC-GRPO2026.05 | 24.3 | 23.6 | 28.2 | 25 | 28.2 | 30.2 | 26.6 | 25.2 | 25 | 29.2 | 27.9 | 26.9 | 26.7 | |
| Qwen2.5-7B-Instruct + M-SFTMethod Extension=M-SFT2026.05 | 22.7 | 21 | 22.2 | 22.1 | 23.9 | 32.6 | 24.1 | 21.7 | 21.2 | 22.9 | 25.3 | 22.8 | 23.6 | |
| Qwen2.5-7B-Instruct + M-ThinkerMethod Extension=M-Thinker2026.05 | 21.4 | 20.7 | 22.7 | 24.5 | 25.7 | 28.6 | 23.9 | 24.6 | 22.8 | 26.7 | 26.7 | 25.2 | 24.4 | |
| Qwen2.5-7B-Instruct + DITMethod Extension=DIT2026.05 | 21.2 | 19.9 | 26.4 | 23.6 | 23 | 30 | 24 | 21.6 | 23.1 | 24.3 | 25.5 | 23.6 | 23.9 | |
| Qwen2.5-7B-Instruct2026.05 | 20.3 | 21.5 | 24.1 | 25.4 | 23.8 | 28.2 | 23.9 | 20.8 | 24.6 | 24.1 | 25.1 | 23.6 | 23.8 | |
| Qwen2.5-7B-Instruct + QRTMethod Extension=QRT2026.05 | 19.1 | 18.7 | 24.7 | 20.4 | 26.1 | 27.8 | 22.8 | 23 | 19.6 | 23.7 | 24 | 22.6 | 22.7 | |
| Qwen2.5-7B-Instruct + LCPMethod Extension=LCP2026.05 | 18.8 | 19.1 | 23.2 | 18.8 | 22.4 | 29.6 | 22 | 19.9 | 21 | 23.6 | 23 | 21.9 | 21.9 | |
| Qwen2.5-3B-Instruct + Vanilla GRPOMethod Extension=Vanilla GRPO2026.05 | 18.6 | 15.7 | 19.5 | 18.5 | 19.4 | 22.4 | 19 | 16 | 20.4 | 20.1 | 19.1 | 18.9 | 19 | |
| Qwen2.5-3B-Instruct + LC-GRPOMethod Extension=LC-GRPO2026.05 | 16.2 | 15.5 | 17.8 | 16.3 | 17.5 | 22.9 | 17.7 | 16.4 | 15.5 | 20.1 | 19.5 | 17.9 | 17.8 | |
| Qwen2.5-3B-Instruct + LANGMethod Extension=LANG2026.05 | 15.1 | 14.8 | 20.7 | 15.5 | 20.2 | 23.1 | 18.2 | 19.6 | 15.1 | 20.9 | 19.6 | 18.8 | 18.5 | |
| Qwen2.5-3B-Instruct + mGRPOMethod Extension=mGRPO2026.05 | 15 | 15.3 | 18.2 | 12.2 | 17.1 | 19.9 | 16.3 | 16.3 | 14.5 | 18.6 | 16.7 | 16.5 | 16.4 | |
| Qwen2.5-3B-Instruct + LCPMethod Extension=LCP2026.05 | 13.7 | 13.3 | 16.5 | 12.5 | 15.9 | 21.3 | 15.5 | 13.1 | 11 | 16 | 16.7 | 14.2 | 15 | |
| Qwen2.5-3B-Instruct2026.05 | 13.1 | 11 | 16.7 | 13.7 | 15.1 | 23 | 15.4 | 15.9 | 13 | 18.5 | 16.6 | 16 | 15.7 | |
| Qwen2.5-3B-Instruct + M-SFTMethod Extension=M-SFT2026.05 | 12.9 | 12.1 | 18.5 | 13.3 | 17 | 22.4 | 16 | 13.4 | 12.1 | 16.5 | 19.1 | 15.3 | 15.7 | |
| Qwen2.5-3B-Instruct + M-ThinkerMethod Extension=M-Thinker2026.05 | 12.8 | 11.6 | 19.7 | 11.9 | 15.5 | 22.4 | 15.7 | 15 | 12.2 | 17.2 | 17.7 | 15.5 | 15.6 | |
| Qwen2.5-3B-Instruct + DITMethod Extension=DIT2026.05 | 12.6 | 12.6 | 17 | 12.7 | 17.4 | 23.2 | 15.9 | 14.9 | 12.5 | 17.8 | 17.9 | 15.8 | 15.8 | |
| Qwen2.5-3B-Instruct + QRTMethod Extension=QRT2026.05 | 12.4 | 11.4 | 17.2 | 13.2 | 17.9 | 22.3 | 15.7 | 14.1 | 12.3 | 16.8 | 18.6 | 15.5 | 15.6 |