Generation on DollyEval (test)
62.02LLM-as-a-Judge ScoreATKD
Evaluation results
| Method | Links | |
|---|---|---|
| ATKDTeacher model=OPT-13B, Student model=OPT-125M, Training=Supervised KD + ATKD2024.02 | 62.02 | |
| Supervised KDTeacher model=OPT-13B, Student model=OPT-125M2024.02 | 58.59 |