Mathematical Reasoning on GSM8K (Pass@8, Avg@8)
83.85Average Score @8PowerOPD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=5002026.06 | 83.85 | 94.16 | 322 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=1002026.06 | 83.06 | 93.93 | 319 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, Stabilization=Z-Score2026.06 | 80.26 | 95.22 | 323 | |
| Full-vocabulary KL OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base2026.06 | 80.25 | 86.5 | 4,095 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=0.12026.06 | 79.96 | 94.31 | 319 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=52026.06 | 79.54 | 94.16 | 312 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=102026.06 | 78.79 | 93.93 | 321 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=0.52026.06 | 78.22 | 94.77 | 308 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, Stabilization=Tanh2026.06 | 78.02 | 94.92 | 321 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base2026.06 | 77.55 | 95.07 | 323 | |
| Vanilla OPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, Stabilization=Clip2026.06 | 76.96 | 94.84 | 308 | |
| PowerOPDTeacher=Qwen3-8B, Student=Qwen3-1.7B-Base, alpha=12026.06 | 76.21 | 94.31 | 311 |