Mathematical Reasoning on AIME25 (Accuracy (avg@32))
15.6Accuracy (avg@32)LESS
Evaluation Results
| Method | Links | |
|---|---|---|
| LESSBackbone=Qwen2.5-Math-7B2025.11 | 15.6 | |
| Forking TokensBackbone=Qwen2.5-Math-7B2025.11 | 14.2 | |
| KL-CovBackbone=Qwen2.5-Math-7B2025.11 | 14.1 | |
| GRPOBackbone=Qwen2.5-Math-7B2025.11 | 13.8 | |
| LESSBackbone=Qwen2.5-Base-7B2025.11 | 13.1 | |
| LESSBackbone=Qwen2.5-Math-1.5B2025.11 | 12.4 | |
| Forking TokensBackbone=Qwen2.5-Base-7B2025.11 | 12.3 | |
| GRPOBackbone=Qwen2.5-Base-7B2025.11 | 11.9 | |
| KL-CovBackbone=Qwen2.5-Base-7B2025.11 | 10.8 | |
| KL-CovBackbone=Qwen2.5-Math-1.5B2025.11 | 9.2 | |
| Base LLMBackbone=Qwen2.5-Math-7B2025.11 | 8.9 | |
| Forking TokensBackbone=Qwen2.5-Math-1.5B2025.11 | 7 | |
| GRPOBackbone=Qwen2.5-Math-1.5B2025.11 | 6.6 | |
| Base LLMBackbone=Qwen2.5-Base-7B2025.11 | 5.2 | |
| Base LLMBackbone=Qwen2.5-Math-1.5B2025.11 | 3.8 |