List your company
ResearchFormerly WizWand

Instruction Following on UltraFeed

84.9Win RateTeacher
36.33248.94161.5574.159Oct 13, 2025Nov 12, 2025Dec 13, 2025Jan 12, 2026Feb 12, 2026Mar 14, 2026Apr 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TeacherModel=Qwen2.5-14B-Instruct2025.1084.9
MT (Teacher)Distillation Pair (Teacher Model -> Student Model)=Qwen2.5-7B-Inst -> Qwen2.5-1.5B2026.0477.16
DistilLLMDistillation Pair (Teacher Model -> Student Model)=Qwen2.5-7B-Inst -> Qwen2.5-1.5B2026.0465.92
VCRDDistillation Pair (Teacher Model -> Student Model)=Qwen2.5-7B-Inst -> Qwen2.5-1.5B2026.0465.67
DistillLM-2Distillation Pair (Teacher Model -> Student Model)=Qwen2.5-7B-Inst -> Qwen2.5-1.5B2026.0465.57
MT (Teacher)Distillation Pair (Teacher Model -> Student Model)=Qwen2-7B-Inst -> Qwen2-1.5B2026.0464.86
DistiLLM-2α=-5, Teacher Model=Qwen2.5-14B-Instruct, Student Model=Qwen2.5-1.5B-Instruct2025.1063.6
KDDistillation Pair (Teacher Model -> Student Model)=Qwen2.5-7B-Inst -> Qwen2.5-1.5B2026.0462.6
DistiLLM-2α=-1, Teacher Model=Qwen2.5-14B-Instruct, Student Model=Qwen2.5-1.5B-Instruct2025.1061.7
SeqKDDistillation Pair (Teacher Model -> Student Model)=Qwen2.5-7B-Inst -> Qwen2.5-1.5B2026.0452.89
DistillLM-2Distillation Pair (Teacher Model -> Student Model)=Qwen2-7B-Inst -> Qwen2-1.5B2026.0451.97
VCRDDistillation Pair (Teacher Model -> Student Model)=Qwen2-7B-Inst -> Qwen2-1.5B2026.0451.56
DistilLLMDistillation Pair (Teacher Model -> Student Model)=Qwen2-7B-Inst -> Qwen2-1.5B2026.0451.26
KDDistillation Pair (Teacher Model -> Student Model)=Qwen2-7B-Inst -> Qwen2-1.5B2026.0449.25
MS (Student)Distillation Pair (Teacher Model -> Student Model)=Qwen2.5-7B-Inst -> Qwen2.5-1.5B2026.0442.94
StudentModel=Qwen2.5-1.5B-Instruct2025.1040.4
SeqKDDistillation Pair (Teacher Model -> Student Model)=Qwen2-7B-Inst -> Qwen2-1.5B2026.0439.1
MS (Student)Distillation Pair (Teacher Model -> Student Model)=Qwen2-7B-Inst -> Qwen2-1.5B2026.0438.2