Mathematical Reasoning on GSM8K (evaluation)
93.3AccuracyReasoning
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ReasoningModel=Qwen3-8B2026.01 | 93.3 | 1,632 | — | |
| KV-ClassificationModel=Qwen3-8B2026.01 | 91.4 | 554 | -66.1 | |
| Fast ThinkingModel=Qwen3-8B2026.01 | 90.4 | 211 | — | |
| KV-GenerativeModel=Qwen3-8B2026.01 | 89.2 | 273 | -83.3 | |
| ReasoningModel=DeepSeek-R1-14B2026.01 | 84.7 | 432 | — | |
| Fast ThinkingModel=DeepSeek-R1-14B2026.01 | 84.5 | 218 | — | |
| KV-ClassificationModel=DeepSeek-R1-14B2026.01 | 84.5 | 218 | -49.5 | |
| KV-GenerativeModel=DeepSeek-R1-14B2026.01 | 83.5 | 242 | -44 |