Mathematical Reasoning on MMLU-Pro Math
89.79AccuracyMAC
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MAC2025.07 | 89.79 | 91.52 | 93.47 | 99 | 88.77 | |
| Debate2025.07 | 86.75 | 88.19 | 89.92 | 98.69 | 85.38 | |
| QWQParameters=32B2025.07 | 85.12 | 89.24 | 93.81 | 98.59 | 84.06 | |
| Deepseek-R1Parameters=32B2025.07 | 84.9 | 88.45 | 92.4 | 98.56 | 83.69 | |
| OpenthinkerParameters=32B2025.07 | 84.83 | 88.34 | 92.31 | 98.55 | 83.6 | |
| Phi4Parameters=14B2025.07 | 79.42 | 80.9 | 82.79 | 97.95 | 77.28 | |
| Qwen2.5-14B (Teacher)Model Scale=14B2026.02 | 77.6 | — | — | — | — | |
| Qwen2.5-14BRole=Teacher2026.02 | 77.6 | — | — | — | — | |
| Qwen2.5Parameters=32B2025.07 | 76.68 | 77.88 | 79.37 | 97.67 | 74.2 | |
| Qwen2.5Parameters=14B2025.07 | 73.95 | 75.07 | 76.6 | 97.39 | 71.17 | |
| TSD-KDselection=Adaptive c%2026.02 | 38.5 | — | — | — | — | |
| TSD-KDDistillation Setup=Qwen2.5 (14B -> 1.5B)2026.02 | 36.9 | — | — | — | — | |
| MiniLLMDistillation Setup=Qwen2.5 (14B -> 1.5B)2026.02 | 36.2 | — | — | — | — | |
| MiniLLM2026.02 | 36.2 | — | — | — | — | |
| GKDbeta=0.9, Distillation Setup=Qwen2.5 (14B -> 1.5B)2026.02 | 35.7 | — | — | — | — | |
| GKDbeta=0.92026.02 | 35.7 | — | — | — | — | |
| Supervised-KDDistillation Setup=Qwen2.5 (14B -> 1.5B)2026.02 | 35.3 | — | — | — | — | |
| Supervised-KD2026.02 | 35.3 | — | — | — | — | |
| DistiLLMDistillation Setup=Qwen2.5 (14B -> 1.5B)2026.02 | 35.2 | — | — | — | — | |
| DistiLLM2026.02 | 35.2 | — | — | — | — | |
| Speculative KDDistillation Setup=Qwen2.5 (14B -> 1.5B)2026.02 | 34.8 | — | — | — | — | |
| Speculative KD2026.02 | 34.8 | — | — | — | — | |
| Qwen2.5-1.5B (Student)Model Scale=1.5B2026.02 | 34.4 | — | — | — | — | |
| Qwen2.5-1.5BRole=Student2026.02 | 34.4 | — | — | — | — | |
| Sequence-Level KDDistillation Setup=Qwen2.5 (14B -> 1.5B)2026.02 | 32.6 | — | — | — | — | |
| Sequence-Level KD2026.02 | 32.6 | — | — | — | — |