Mathematical Reasoning on AIME 2024 (ACC, Avg Tokens)
81.48ACC (%)Qwen3-8B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen3-8Bstrategy=step-entropy pruning, pruning_ratio=80%2025.08 | 81.48 | 11,533.57 | |
| Qwen3-8Bstrategy=Full COT2025.08 | 79.31 | 20,936.57 | |
| QwQ-32Bstrategy=Full COT2025.08 | 79.13 | 21,243.93 | |
| QwQ-32Bstrategy=step-entropy pruning, pruning_ratio=80%2025.08 | 74.07 | 9,544.13 | |
| DeepSeek-R1-14Bstrategy=Full COT2025.08 | 65.52 | 15,414.83 | |
| DeepSeek-R1-7Bstrategy=Full COT2025.08 | 63.33 | 15,843.43 | |
| DeepSeek-R1-14Bstrategy=step-entropy pruning, pruning_ratio=80%2025.08 | 58.62 | 8,705.57 | |
| DeepSeek-R1-7Bstrategy=step-entropy pruning, pruning_ratio=80%2025.08 | 56.67 | 10,092.8 |