General Instruction Following on MMLU style (test)
51.06AccuracyStudent (Self-Distillation)
Evaluation results
| Method | Links | |
|---|---|---|
| Student (Self-Distillation)Parameters=7B, Base Model=LLaMA-2-7B2026.02 | 51.06 | |
| TeacherParameters=7B, Base Model=LLaMA-2-7B2026.02 | 50.31 | |
| InherNetParameters=4.2B, Base Model=LLaMA-2-7B, Number of experts (H)=4, Rank (r)=2562026.02 | 49.82 |