Math reasoning on MATH 500 (Generation Efficiency and Accuracy)
802.3Average Output LengthQwen-2.5-7B-Instruct
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen-2.5-7B-InstructSpeculative Model=Qwen-2.5-7B-Instruct, Target Model=None2025.04 | 802.3 | — | 58.3 | 74 | — | |
| Speculative ThinkingSpeculative Model=Qwen-2.5-7B-Instruct, Target Model=32B2025.04 | 3,015.9 | 44 | 31.7 | 81.8 | 7.8 | |
| Speculative ThinkingSpeculative Model=Qwen-2.5-7B-Instruct, Target Model=7B2025.04 | 3,172 | 44 | 41.2 | 79.2 | 5.2 | |
| Speculative ThinkingSpeculative Model=Qwen-2.5-7B-Instruct, Target Model=1.5B2025.04 | 3,368.8 | 43 | 53.1 | 74.8 | 0.8 |