Instruction Tuning on SelfInst (RougeL)
21.31ROUGE-LARMADA
Evaluation results
| Method | Links | |
|---|---|---|
| ARMADATeacher=text-to-video, Distillation Type=L_euclid2026.03 | 21.31 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_cosine2026.03 | 20.08 | |
| ARMADATeacher=text-to-image, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 19.83 | |
| ARMADATeacher=text-to-image, Distillation Type=L_elementwise2026.03 | 19.8 | |
| ARMADATeacher=text-to-audio, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 19.57 | |
| ARMADATeacher=text-to-image, Distillation Type=L_cosine2026.03 | 19.36 | |
| ARMADATeacher=text-to-image, Distillation Type=L_euclid2026.03 | 19.14 | |
| ARMADATeacher=text-to-video, Distillation Type=L_elementwise2026.03 | 18.97 | |
| ARMADATeacher=text-to-video, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 18.96 | |
| ARMADATeacher=text-to-audio, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 18.92 | |
| ARMADATeacher=text-to-video, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 18.84 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_elementwise2026.03 | 18.73 | |
| ARMADATeacher=text-to-audio, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 18.66 | |
| SeqKDTeacher=language-only, Distillation Type=SeqKD, Student Model=LLaMA-3.2-3B2026.03 | 18.61 | |
| ARMADATeacher=text-to-video, Distillation Type=L_cosine2026.03 | 18.57 | |
| ARMADATeacher=text-to-video, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 18.49 | |
| UndistilledTeacher=-, Distillation Type=undistilled, Student Model=LLaMA-3.2-3B2026.03 | 18.44 | |
| ARMADATeacher=text-to-image, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 18.28 | |
| ARMADATeacher=text-to-image, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 18.06 | |
| LLaMA-3.1-8BDistillation Type=undistilled2026.03 | 18.01 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_euclid2026.03 | 17.47 |