Instruction-tuning on Dolly (RougeL)
35.34RougeLLLaMA-3.1-8B
Evaluation results
| Method | Links | |
|---|---|---|
| LLaMA-3.1-8BDistillation Type=undistilled2026.03 | 35.34 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_euclid2026.03 | 34.78 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_elementwise2026.03 | 34.67 | |
| ARMADATeacher=text-to-image, Distillation Type=L_elementwise2026.03 | 34.63 | |
| ARMADATeacher=text-to-image, Distillation Type=L_euclid2026.03 | 33.71 | |
| ARMADATeacher=text-to-image, Distillation Type=L_cosine2026.03 | 33.67 | |
| ARMADATeacher=text-to-video, Distillation Type=L_cosine2026.03 | 33.53 | |
| ARMADATeacher=text-to-audio, Distillation Type=L_cosine2026.03 | 33.14 | |
| ARMADATeacher=text-to-video, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 33.07 | |
| ARMADATeacher=text-to-video, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 33.02 | |
| ARMADATeacher=text-to-audio, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 32.95 | |
| ARMADATeacher=text-to-audio, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 32.81 | |
| ARMADATeacher=text-to-audio, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 32.68 | |
| ARMADATeacher=text-to-video, Distillation Type=L_euclid2026.03 | 32.02 | |
| ARMADATeacher=text-to-image, Loss Function=L_cosine, Student Model=LLaMA-3.2-3B2026.03 | 31.94 | |
| ARMADATeacher=text-to-video, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 31.85 | |
| SeqKDTeacher=language-only, Distillation Type=SeqKD, Student Model=LLaMA-3.2-3B2026.03 | 31.45 | |
| ARMADATeacher=text-to-image, Loss Function=L_elementwise, Student Model=LLaMA-3.2-3B2026.03 | 31.38 | |
| UndistilledTeacher=-, Distillation Type=undistilled, Student Model=LLaMA-3.2-3B2026.03 | 31.3 | |
| ARMADATeacher=text-to-image, Loss Function=L_euclid, Student Model=LLaMA-3.2-3B2026.03 | 30.57 | |
| ARMADATeacher=text-to-video, Distillation Type=L_elementwise2026.03 | 30.44 |