Reasoning (pass@1) on ARC-C
81.23Pass@1Teacher
Evaluation Results
| Method | Links | |
|---|---|---|
| TeacherModel=Gemma3-4B2026.05 | 81.23 | |
| Reverse KLDistillation Family=KL Divergence Family2026.05 | 27.58 | |
| Bridge-Garden (Skew RKL)Distillation Family=Distance & Skewed Family2026.05 | 26.92 | |
| Skew FKLDistillation Family=Distance & Skewed Family2026.05 | 26.14 | |
| Bridge-Garden (Skew FKL)Distillation Family=Distance & Skewed Family2026.05 | 26.07 | |
| α-β divergenceDistillation Family=Unified Divergence Family2026.05 | 26.07 | |
| Bridge-Garden (Reverse KL)Distillation Family=KL Divergence Family2026.05 | 26.03 | |
| Skew RKLDistillation Family=Distance & Skewed Family2026.05 | 25.93 | |
| Bridge-Garden (α-β divergence)Distillation Family=Unified Divergence Family2026.05 | 25.9 | |
| Total VariationDistillation Family=Distance & Skewed Family2026.05 | 25.83 | |
| Bridge-Garden (Forward KL)Distillation Family=KL Divergence Family2026.05 | 25.69 | |
| Bridge-Garden (Total Variation)Distillation Family=Distance & Skewed Family2026.05 | 25.39 | |
| Forward KLDistillation Family=KL Divergence Family2026.05 | 25 | |
| Hard KDTeacher Model=Gemma3-4B, Student Model=Gemma3-1B2026.05 | 18.09 | |
| Student (No Distill)Model=Gemma3-1B2026.05 | 15.7 |