Generation on WizardLM (test)
48.37LLM-as-a-Judge ScoreATKD
Evaluation results
| Method | Links | |
|---|---|---|
| ATKDTeacher model=OPT-13B, Student model=OPT-125M, Training=Supervised KD + ATKD2024.02 | 48.37 | |
| Supervised KDTeacher model=OPT-13B, Student model=OPT-125M2024.02 | 42.44 |