Mathematical Reasoning on AIME25 (Avg@8, Pass@8, Length)
5.83Avg@8Full-vocabulary KL OPD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Full-vocabulary KL OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base2026.06 | 5.83 | 26.67 | 4,096 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=5002026.06 | 5.83 | 16.67 | 2,557 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=0.52026.06 | 5.42 | 20 | 2,962 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=12026.06 | 5 | 16.67 | 3,019 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, Stabilization=Tanh2026.06 | 4.58 | 20 | 3,012 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=102026.06 | 4.58 | 16.67 | 2,853 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, Stabilization=Z-Score2026.06 | 4.17 | 13.33 | 2,964 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=0.12026.06 | 3.75 | 13.33 | 3,024 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=52026.06 | 3.75 | 13.33 | 2,939 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=1002026.06 | 3.33 | 13.33 | 2,928 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base2026.06 | 3.3 | 16.67 | 2,957 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, Stabilization=Clip2026.06 | 3.3 | 16.67 | 2,935 |