Instruction Tuning on SNI
29.63RougeLARMADA
Evaluation Results
| Method | Links | |
|---|---|---|
| ARMADATeacher=text-to-audio, Distillation Type=L_cosine2026.03 | 29.63 | |
| ARMADATeacher=text-to-video, Distillation Type=L_cosine2026.03 | 29.28 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_elementwise2026.03 | 29.13 | |
| ARMADATeacher=text-to-image, Distillation Type=L_elementwise2026.03 | 29.06 | |
| ARMADATeacher=text-to-image, Distillation Type=L_cosine2026.03 | 28.77 | |
| SeqKDTeacher=language-only, Distillation Type=SeqKD, Student Model=LLaMA-3.2-3B2026.03 | 28.48 | |
| ARMADATeacher=text-to-image, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 28.25 | |
| LLaMA-3.1-8BDistillation Type=undistilled2026.03 | 28.19 | |
| ARMADATeacher=text-to-image, Distillation Type=L_euclid2026.03 | 28.11 | |
| ARMADATeacher=text-to-video, Distillation Type=L_euclid2026.03 | 28.07 | |
| ARMADATeacher=text-to-audio, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 28.07 | |
| ARMADATeacher=text-to-video, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 27.75 | |
| ARMADATeacher=text-to-audio, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 27.7 | |
| ARMADATeacher=text-to-video, Distillation Type=L_elementwise2026.03 | 27.56 | |
| ARMADATeacher=text-to-audio, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 27.46 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_euclid2026.03 | 27.26 | |
| ARMADATeacher=text-to-image, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 27.13 | |
| ARMADATeacher=text-to-video, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 26.98 | |
| UndistilledTeacher=-, Distillation Type=undistilled, Student Model=LLaMA-3.2-3B2026.03 | 26.68 | |
| ARMADATeacher=text-to-image, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 26.68 | |
| ARMADATeacher=text-to-video, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 26.57 |