List your company
ResearchFormerly WizWand

Instruction Following on S-NI (OOD)

36.1Rouge-LTeacher
15.50820.85426.231.546Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
TeacherBackbone=LLaMA, Parameters=13B2026.0636.1
ARKDBackbone=LLaMA, Parameters=7B2026.0635.5
FKL+RKLBackbone=LLaMA, Parameters=7B2026.0634.7
RKLBackbone=LLaMA, Parameters=7B2026.0634.1
FKLBackbone=LLaMA, Parameters=7B2026.0633.8
SeqKDBackbone=LLaMA, Parameters=7B2026.0633.3
SFT w/o KDBackbone=LLaMA, Parameters=7B2026.0632.4
TeacherBackbone=GPT-2, Parameters=1.5B2026.0627.2
ARKDBackbone=GPT-2, Parameters=340M2026.0626.8
FKL+RKLBackbone=GPT-2, Parameters=340M2026.0626.3
RKLBackbone=GPT-2, Parameters=340M2026.0626.1
FKLBackbone=GPT-2, Parameters=340M2026.0625.7
SeqKDBackbone=GPT-2, Parameters=340M2026.0625.4
SFT w/o KDBackbone=GPT-2, Parameters=340M2026.0624.9
ARKDBackbone=GPT-2, Parameters=120M2026.0619.1
FKL+RKLBackbone=GPT-2, Parameters=120M2026.0617.8
RKLBackbone=GPT-2, Parameters=120M2026.0617.2
FKLBackbone=GPT-2, Parameters=120M2026.0616.6
SFT w/o KDBackbone=GPT-2, Parameters=120M2026.0616.4
SeqKDBackbone=GPT-2, Parameters=120M2026.0616.3