List your company
ResearchFormerly WizWand

Code Generation on MBPP+ strict evaluation

0.468AccuracyTuneShift-KD
0.241280.300140.3590.41786Mar 25, 2026
Updated 7mo ago

Evaluation results

MethodLinks
TuneShift-KDSource Model=Gemma-2B, Target Model=Gemma-7B, Evaluation Setup=Target LoRA2026.030.4680.061
TuneShift-KDSource Model=Gemma-2B, Target Model=Gemma-7B, Evaluation Setup=Target (no LoRA)2026.030.407—
Trans-LoRASource Model=Gemma-2B, Target Model=Gemma-7B, Evaluation Setup=Target LoRA2026.030.4060.085
Trans-LoRASource Model=Llama2-7B, Target Model=Llama2-13B, Evaluation Setup=Target LoRA2026.030.3440.027
TuneShift-KDSource Model=Llama2-7B, Target Model=Llama2-13B, Evaluation Setup=Target LoRA2026.030.3390.023
Trans-LoRASource Model=Gemma-2B, Target Model=Gemma-7B, Evaluation Setup=Source LoRA2026.030.339—
TuneShift-KDSource Model=Gemma-2B, Target Model=Gemma-7B, Evaluation Setup=Source LoRA2026.030.324—
Trans-LoRASource Model=Gemma-2B, Target Model=Gemma-7B, Evaluation Setup=Target (no LoRA)2026.030.321—
Trans-LoRASource Model=Llama2-7B, Target Model=Llama2-13B, Evaluation Setup=Target (no LoRA)2026.030.317—
TuneShift-KDSource Model=Llama2-7B, Target Model=Llama2-13B, Evaluation Setup=Target (no LoRA)2026.030.316—
TuneShift-KDSource Model=Llama2-7B, Target Model=Llama2-13B, Evaluation Setup=Source LoRA2026.030.257—
Trans-LoRASource Model=Llama2-7B, Target Model=Llama2-13B, Evaluation Setup=Source LoRA2026.030.25—