Code Generation on HE+
86.6AccuracyQwen3-30B-A3B-Instruct-2507
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-30B-A3B-Instruct-2507Role=Teacher Model2026.06 | 86.6 | |
| Teacher ModelModel=Qwen3-4B-Instruct-2507, Teacher-Student Overlap=Large2026.06 | 82.5 | |
| IW-OPDStudent=Qwen3-4B2026.06 | 78.7 | |
| IW-OPDStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 77.9 | |
| IW-OPD10Student Model=Qwen3-4B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 77.8 | |
| OPDStudent=Qwen3-4B2026.06 | 77.2 | |
| IW-OPDStudent=Qwen3-4B, Training Step=102026.06 | 76.8 | |
| OPDStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 76.3 | |
| OPDStudent=Qwen3-4B, Training Step=102026.06 | 76.2 | |
| OPD10Student Model=Qwen3-4B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 76 | |
| BaseStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 75.3 | |
| BaseStudent=Qwen3-4B2026.06 | 75.3 | |
| IW-OPDStudent=Qwen3-1.7B2026.06 | 65.2 | |
| OPDStudent=Qwen3-1.7B2026.06 | 64.6 | |
| IW-OPDStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 62.8 | |
| IW-OPD10Student Model=Qwen3-1.7B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 62 | |
| OPDStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 61.5 | |
| OPD10Student Model=Qwen3-1.7B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 61.1 | |
| BaseStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 59.6 | |
| BaseStudent=Qwen3-1.7B2026.06 | 59.6 | |
| IW-OPDStudent=Qwen3-1.7B, Training Step=102026.06 | 55.5 | |
| OPDStudent=Qwen3-1.7B, Training Step=102026.06 | 53 | |
| IW-OPDStudent=Qwen3-0.6B2026.06 | 32.5 | |
| IW-OPDStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 31.6 | |
| OPDStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 29.8 | |
| OPDStudent=Qwen3-0.6B2026.06 | 29.6 | |
| IW-OPDStudent=Qwen3-0.6B, Training Step=102026.06 | 28.4 | |
| BaseStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 28.2 | |
| BaseStudent=Qwen3-0.6B2026.06 | 28.2 | |
| IW-OPD10Student Model=Qwen3-0.6B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 28.1 | |
| OPDStudent=Qwen3-0.6B, Training Step=102026.06 | 26.9 | |
| OPD10Student Model=Qwen3-0.6B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 26.8 |