Mathematical Reasoning on MATH500 (Accuracy, Token Usage, and Reduction)
61AccuracyReasoning
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ReasoningModel=Qwen3-8B2026.01 | 61 | 4,150 | — | |
| KV-ClassificationModel=Qwen3-8B2026.01 | 60.4 | 3,963 | -4.5 | |
| ReasoningModel=DeepSeek-R1-14B2026.01 | 59 | 1,839 | — | |
| KV-ClassificationModel=DeepSeek-R1-14B2026.01 | 57.8 | 1,506 | -18.1 | |
| KV-GenerativeModel=Qwen3-8B2026.01 | 57.8 | 727 | -82.5 | |
| Fast ThinkingModel=Qwen3-8B2026.01 | 56.8 | 616 | — | |
| KV-GenerativeModel=DeepSeek-R1-14B2026.01 | 56.6 | 657 | -64.3 | |
| Fast ThinkingModel=DeepSeek-R1-14B2026.01 | 53.6 | 540 | — |