List your company
ResearchFormerly WizWand

Code Generation on MBPP+ (accuracy %)

75.1Accuracy (%)Qwen3-30B-A3B-Instruct-2507
21.0235.0649.163.14Jun 21, 2026Jun 22, 2026Jun 23, 2026Jun 24, 2026Jun 25, 2026Jun 26, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Qwen3-30B-A3B-Instruct-2507Role=Teacher Model2026.0675.1
Teacher ModelModel=Qwen3-4B-Instruct-2507, Teacher-Student Overlap=Large2026.0671.3
IW-OPDStudent=Qwen3-4B2026.0670.9
OPDStudent=Qwen3-4B2026.0669.1
IW-OPDStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.0668.2
IW-OPDStudent=Qwen3-4B, Training Step=102026.0668.1
OPDStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.0667.8
IW-OPD10Student Model=Qwen3-4B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.0667.5
OPDStudent=Qwen3-4B, Training Step=102026.0666.7
OPD10Student Model=Qwen3-4B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.0666.1
DynaSteerBackbone=Qwen3-8B2026.0665.61
BaseStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.0664.5
BaseStudent=Qwen3-4B2026.0664.5
ROMEBackbone=Qwen3-8B2026.0655.82
IW-OPDStudent=Qwen3-1.7B2026.0655
IW-OPDStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.0654.9
IW-OPDStudent=Qwen3-1.7B, Training Step=102026.0654.8
DynaSteerBackbone=Qwen3-1.7B2026.0654.5
IW-OPD10Student Model=Qwen3-1.7B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.0654
OPDStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.0653.7
OPDStudent=Qwen3-1.7B2026.0653.7
MEMITBackbone=Qwen3-8B2026.0653.7
OPD10Student Model=Qwen3-1.7B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.0653.4
OPDStudent=Qwen3-1.7B, Training Step=102026.0652.6
BaseStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.0652.5
BaseStudent=Qwen3-1.7B2026.0652.5
TruthFlowBackbone=Qwen3-1.7B2026.0652.12
TruthXBackbone=Qwen3-1.7B2026.0651.06
IW-OPDStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.0635.7
IW-OPD10Student Model=Qwen3-0.6B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.0633.9
OPDStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.0633.3
IW-OPDStudent=Qwen3-0.6B2026.0631.9
OPD10Student Model=Qwen3-0.6B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.0631
OPDStudent=Qwen3-0.6B2026.0628.7
BaseStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.0628.4
BaseStudent=Qwen3-0.6B2026.0628.4
IW-OPDStudent=Qwen3-0.6B, Training Step=102026.0627.5
OPDStudent=Qwen3-0.6B, Training Step=102026.0623.1