Mathematical Reasoning on MultiArith (pass@1)
82.5Pass@1 RateQwen2.5-1.5B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-1.5Bmode=zero-shot2026.06 | 82.5 | |
| Coconut + dropout-GRPOseeds=32026.06 | 64.67 | |
| Coconut SFTbaseline=true, seeds=12026.06 | 61.67 | |
| Coconut + GRPOrollout=deterministic, seeds=32026.06 | 61.67 | |
| Coconut + REINFORCE + dropoutbaseline_type=EMA, seeds=32026.06 | 57.39 |