Generation on VicunaEval (test)
56.07LLM Judge ScoreATKD
Evaluation results
| Method | Links | |
|---|---|---|
| ATKDTeacher model=OPT-13B, Student model=OPT-125M, Training=Supervised KD + ATKD2024.02 | 56.07 | |
| Supervised KDTeacher model=OPT-13B, Student model=OPT-125M2024.02 | 48.88 |