Mathematical Reasoning on (MATH500, Olympiad, AMC, AIME24, AIME25, GSM8K) (test, pass@1)
44.4Average ScoreTrust-Region behavior Blending
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Trust-Region behavior BlendingBase Model=Qwen3-0.6B-Base, Teacher Model=Qwen3-4B2026.05 | 44.4 | 53.6 | 22.3 | 31.6 | — | — | 70.1 | |
| Interleaved teacher injection (SKD)Base Model=Qwen3-0.6B-Base, Teacher Model=Qwen3-4B2026.05 | 44.2 | 52.8 | 22.2 | 31.5 | — | — | 70.1 | |
| Vanilla OPDBase Model=Qwen3-0.6B-Base, Teacher Model=Qwen3-4B2026.05 | 44 | 53.1 | 21.8 | 31.1 | — | — | 69.9 | |
| Temperature warmupBase Model=Qwen3-0.6B-Base, Teacher Model=Qwen3-4B2026.05 | 44 | 53.1 | 21.8 | 32.1 | — | — | 69.1 | |
| Fixed-ε blendingBase Model=Qwen3-0.6B-Base, Teacher Model=Qwen3-4B2026.05 | 43.8 | 52.7 | 21.5 | 31.1 | — | — | 69.8 | |
| VetoBase Model=Qwen3-0.6B-Base, Teacher Model=Qwen3-4B2026.05 | 43.7 | 52.4 | 21.2 | 32.3 | — | — | 68.9 | |
| SFT warmupBase Model=Qwen3-0.6B-Base, Teacher Model=Qwen3-4B2026.05 | 43.4 | 52.3 | 21.6 | 30.4 | — | — | 69.3 | |
| Trust-Region behavior BlendingBase Model=Qwen3-1.7B-Base, Teacher Model=Qwen3-8B2026.05 | 33.2 | 69.7 | 34.3 | 44.8 | 10.2 | 6.9 | — | |
| Temperature warmupBase Model=Qwen3-1.7B-Base, Teacher Model=Qwen3-8B2026.05 | 32.8 | 69.2 | 34.1 | 44.2 | 9.9 | 6.6 | — | |
| Interleaved teacher injection (SKD)Base Model=Qwen3-1.7B-Base, Teacher Model=Qwen3-8B2026.05 | 32.7 | 69.4 | 33.8 | 44.2 | 9.8 | 6.6 | — | |
| VetoBase Model=Qwen3-1.7B-Base, Teacher Model=Qwen3-8B2026.05 | 32.6 | 69.4 | 34 | 43.1 | 9.3 | 7.3 | — | |
| Fixed-ε blendingBase Model=Qwen3-1.7B-Base, Teacher Model=Qwen3-8B2026.05 | 32.6 | 69.2 | 33.7 | 43.7 | 10.3 | 6.2 | — | |
| Vanilla OPDBase Model=Qwen3-1.7B-Base, Teacher Model=Qwen3-8B2026.05 | 32.3 | 69.1 | 33.7 | 43 | 8.8 | 7.1 | — | |
| SFT warmupBase Model=Qwen3-1.7B-Base, Teacher Model=Qwen3-8B2026.05 | 32.2 | 67.6 | 34 | 42.4 | 9.6 | 7.1 | — |