Mathematical Reasoning on AIME25 (Avg@8, Pass@8, Response Length)
3.33Avg@8Full-vocab
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Full-vocabTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Full-vocab2026.06 | 3.33 | 6.67 | 4,096 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=52026.06 | 3.33 | 13.33 | 3,468 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=5002026.06 | 2.08 | 13.33 | 2,742 | |
| Vanilla + ClipTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla, Param=+ Clip2026.06 | 1.67 | 10 | 3,711 | |
| Vanilla + TanhTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla, Param=+ Tanh2026.06 | 1.67 | 6.67 | 3,639 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=1002026.06 | 1.25 | 10 | 3,225 | |
| VanillaTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla2026.06 | 0.83 | 6.67 | 3,752 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=0.12026.06 | 0.83 | 6.67 | 3,617 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=0.52026.06 | 0.83 | 6.67 | 3,549 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=12026.06 | 0.83 | 3.33 | 3,542 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=102026.06 | 0.83 | 6.67 | 3,528 | |
| Vanilla + Z-ScoreTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=Vanilla, Param=+ Z-Score2026.06 | 0.42 | 3.33 | 3,578 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-0.6B-Base, Class=PowerOPD, alpha=502026.06 | 0.42 | 6.67 | 3,233 |