Mathematical Reasoning on AMC23 (Avg Length, Modify Ratio, Speed, Accuracy, Improvement)
19,376.5Average Output LengthSpeculative Thinking
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Speculative Thinkingspeculative model=1B-Instruct, target model=7B, pass@1=true2025.04 | 19,376.5 | 23 | 89.2 | 27.5 | 37.5 | |
| Speculative Thinkingspeculative model=1B-Instruct, target model=32B, pass@1=true2025.04 | 17,114.4 | 23 | 65.4 | 30 | 50 | |
| 1B-Instructtarget model=normal, pass@1=true2025.04 | 1,605 | — | 217.6 | 20 | — |