Mathematical Reasoning on Average (GSM8K, MATH500, AIME24)
6.73Latency (s)STACK
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| STACKBackbone=DeepSeek-R1-Distill-Qwen-7B2026.04 | 6.73 | 2.7 | -54.5 | |
| STACKBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.04 | 7.23 | 4.8 | -59.9 | |
| MuTISBackbone=DeepSeek-R1-Distill-Qwen-7B2026.04 | 7.95 | 1.03 | -53.9 | |
| ConCISEBackbone=DeepSeek-R1-Distill-Qwen-7B2026.04 | 8.6 | -2.23 | -46.8 | |
| MuTISBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.04 | 8.83 | 2.07 | -56.7 | |
| ConCISEBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.04 | 9.55 | 0.83 | -51.5 | |
| PromptBackbone=DeepSeek-R1-Distill-Qwen-7B2026.04 | 12.47 | 0.6 | -15.1 | |
| OriginalBackbone=DeepSeek-R1-Distill-Qwen-7B2026.04 | 13.29 | — | — | |
| PromptBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.04 | 15.1 | 0.77 | -7.35 | |
| OriginalBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.04 | 16.14 | — | — |