Instruction Following on Unnatural Instructions (test)
38.07ROUGE-LABKD
Evaluation results
| Method | Links | |
|---|---|---|
| ABKDDistillation Pair=OpenLLaMA2-7B → OpenLLaMA2-3B2025.10 | 38.07 | |
| AMiD (Ours)Distillation Pair=OpenLLaMA2-7B → OpenLLaMA2-3B2025.10 | 37.31 | |
| DistiLLM (SRKL)Distillation Pair=OpenLLaMA2-7B → OpenLLaMA2-3B2025.10 | 35.76 | |
| DistiLLM (SKL)Distillation Pair=OpenLLaMA2-7B → OpenLLaMA2-3B2025.10 | 34.74 | |
| TeacherModel Name=OpenLLaMA2-7B2025.10 | 32.4 | |
| TAIDDistillation Pair=OpenLLaMA2-7B → OpenLLaMA2-3B2025.10 | 31.55 |