Mathematical Reasoning on GSM8K (Pass@8, Avg@8, Response Length)
70.85Avg@8 ScoreFull-vocab
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Full-vocabTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Full-vocab2026.06 | 70.85 | 88.48 | 4,095 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=5002026.06 | 70.58 | 87.04 | 427 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=502026.06 | 69.29 | 88.93 | 382 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=1002026.06 | 68.63 | 89.79 | 385 | |
| Vanilla + ClipTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla, Param=+ Clip2026.06 | 67.99 | 87.64 | 398 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=0.52026.06 | 67.58 | 89.16 | 381 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=0.12026.06 | 67.18 | 88.02 | 384 | |
| Vanilla + TanhTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla, Param=+ Tanh2026.06 | 66.98 | 88.63 | 394 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=52026.06 | 66.79 | 88.86 | 364 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=102026.06 | 66.76 | 87.87 | 364 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=12026.06 | 65.36 | 89.76 | 380 | |
| Vanilla + Z-ScoreTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla, Param=+ Z-Score2026.06 | 63.83 | 88.1 | 391 | |
| VanillaTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla2026.06 | 60.59 | 86.35 | 416 |