Generation on SelfInst (test)
60.16LLM-as-a-Judge ScoreATKD
Evaluation results
| Method | Links | |
|---|---|---|
| ATKDTeacher model=OPT-13B, Student model=OPT-125M, Training=Supervised KD + ATKD2024.02 | 60.16 | |
| Supervised KDTeacher model=OPT-13B, Student model=OPT-125M2024.02 | 55.63 |