List your company
ResearchFormerly WizWand

Instruction Following on UnNI (OOD)

39Rouge-LTeacher
17.57623.13828.734.262Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
TeacherBackbone=LLaMA, Parameters=13B2026.0639
ARKDBackbone=LLaMA, Parameters=7B2026.0638.1
FKL+RKLBackbone=LLaMA, Parameters=7B2026.0637.5
RKLBackbone=LLaMA, Parameters=7B2026.0637.1
SeqKDBackbone=LLaMA, Parameters=7B2026.0636.6
FKLBackbone=LLaMA, Parameters=7B2026.0636.5
SFT w/o KDBackbone=LLaMA, Parameters=7B2026.0635.8
TeacherBackbone=GPT-2, Parameters=1.5B2026.0631.6
ARKDBackbone=GPT-2, Parameters=340M2026.0628.4
FKL+RKLBackbone=GPT-2, Parameters=340M2026.0627.8
RKLBackbone=GPT-2, Parameters=340M2026.0627.1
FKLBackbone=GPT-2, Parameters=340M2026.0626.6
SeqKDBackbone=GPT-2, Parameters=340M2026.0626
SFT w/o KDBackbone=GPT-2, Parameters=340M2026.0625.7
ARKDBackbone=GPT-2, Parameters=120M2026.0621.9
FKL+RKLBackbone=GPT-2, Parameters=120M2026.0620.3
RKLBackbone=GPT-2, Parameters=120M2026.0619.8
FKLBackbone=GPT-2, Parameters=120M2026.0619.2
SeqKDBackbone=GPT-2, Parameters=120M2026.0618.5
SFT w/o KDBackbone=GPT-2, Parameters=120M2026.0618.4