Logical Reasoning on Countdown (test)
74.7Accuracy Pass@1Qwen2.5-3B + DAPO w LATR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-3B + DAPO w LATRsampling_strategy=LATR2025.10 | 74.7 | 81.5 | 367 | 453 | |
| Qwen2.5-3B + GRPO w LATRsampling_strategy=LATR2025.10 | 70.9 | 77.4 | 378 | 469 | |
| Qwen2.5-3B + DAPO w Stochasticsampling_strategy=Stochastic2025.10 | 70.7 | 78 | 483 | 630 | |
| Qwen2.5-3B + GRPO w Stochasticsampling_strategy=Stochastic2025.10 | 65.9 | 73.9 | 473 | 610 | |
| Qwen2.5-3B2025.10 | 1.1 | 5.5 | 543 | 975 |