Mathematical Reasoning on GSM8K (Pass@1, Pass@32)
90.28Pass@1LEPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LEPOBase Model=Qwen2.5-7B2026.04 | 90.28 | 98.03 | |
| GRPOBase Model=Qwen2.5-7B, latent inference=true2026.04 | 89.5 | 98.03 | |
| GRPOBase Model=Qwen2.5-7B2026.04 | 89.47 | 97.57 | |
| Soft TokensBase Model=Qwen2.5-7B2026.04 | 87.08 | 94.39 | |
| HRPOBase Model=Qwen2.5-7B2026.04 | 85.97 | 89.46 | |
| LEPOBase Model=Qwen2.5-3B2026.04 | 82.94 | 97.57 | |
| GRPOBase Model=Qwen2.5-3B2026.04 | 81.8 | 97.42 | |
| GRPOBase Model=Qwen2.5-3B, latent inference=true2026.04 | 81.35 | 97.42 | |
| HRPOBase Model=Qwen2.5-3B2026.04 | 77.63 | 89.46 | |
| Soft TokensBase Model=Qwen2.5-3B2026.04 | 77.56 | 91.74 | |
| LEPOBase Model=Llama3.2-3B2026.04 | 77.29 | 96.97 | |
| HRPOBase Model=Llama3.2-3B2026.04 | 77.1 | 90.3 | |
| Soft TokensBase Model=Llama3.2-3B2026.04 | 75.27 | 93.03 | |
| GRPOBase Model=Llama3.2-3B2026.04 | 74.69 | 97.27 | |
| GRPOBase Model=Llama3.2-3B, latent inference=true2026.04 | 74.41 | 96.66 | |
| CoTBase Model=Llama3.2-3B, latent inference=true2026.04 | 73.32 | 97.42 | |
| CoTBase Model=Llama3.2-3B2026.04 | 73.22 | 96.89 | |
| CoTBase Model=Qwen2.5-3B, latent inference=true2026.04 | 72.93 | 98.48 | |
| CoTBase Model=Qwen2.5-3B2026.04 | 72.6 | 98.18 | |
| CoTBase Model=Qwen2.5-7B2026.04 | 44.43 | 98.48 | |
| CoTBase Model=Qwen2.5-7B, latent inference=true2026.04 | 44.21 | 98.71 |