Code Generation on HumanEval+ (Pass@1, AVG)
84.07Average Score (AVG)MT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MTModel=Qwen2.5-Coder-14B-Inst2026.04 | 84.07 | 86.6 | |
| VCRDTeacher=Qwen2.5-Coder-14B-Inst, Student=Qwen2.5-Coder-7B-Inst2026.04 | 81.75 | 83.5 | |
| DistillLM-2Teacher=Qwen2.5-Coder-14B-Inst, Student=Qwen2.5-Coder-7B-Inst2026.04 | 81.37 | 82.3 | |
| DistilLLMTeacher=Qwen2.5-Coder-14B-Inst, Student=Qwen2.5-Coder-7B-Inst2026.04 | 80.75 | 82.3 | |
| HybKDTeacher-Student=DeepSeek-Coder-6.7B -> 1.3B2026.05 | 47.89 | 36.59 | |
| Skew F(R)KLTeacher-Student=DeepSeek-Coder-6.7B -> 1.3B2026.05 | 47.29 | 35.98 | |
| α-β divergenceTeacher-Student=DeepSeek-Coder-6.7B -> 1.3B2026.05 | 47.09 | 36.59 | |
| Forward KLTeacher-Student=DeepSeek-Coder-6.7B -> 1.3B2026.05 | 46.76 | 33.54 | |
| Reverse KLTeacher-Student=DeepSeek-Coder-6.7B -> 1.3B2026.05 | 46.34 | 34.15 | |
| Hard KDTeacher-Student=DeepSeek-Coder-6.7B -> 1.3B2026.05 | 44.66 | 32.93 | |
| 95% (CodeEnhance-gemma-4b+CodeQA) + 5% RawTokens (B)=102026.06 | 43.3 | — | |
| Nemotron-RWTokens (B)=102026.06 | 42.1 | — | |
| 90% (CodeEnhance-gemma-4b+CodeQA) + 10% RawTokens (B)=102026.06 | 41.5 | — | |
| 80% CodeEnhance-gemma-4b + 15% CodeQA + 5% RawTokens (B)=102026.06 | 41.5 | — | |
| CodeEnhance+Nemotron-RW+SwallowCodeTokens (B)=102026.06 | 41.5 | — | |
| CodeEnhance+CodeQATokens (B)=102026.06 | 41.5 | — | |
| 50% CodeEnhance + 50% Nemotron-RWTokens (B)=102026.06 | 40.9 | — | |
| 85% CodeEnhance-gemma-4b + 10% CodeQA + 5% RawTokens (B)=102026.06 | 39.6 | — | |
| SwallowCodeTokens (B)=102026.06 | 39 | — | |
| 75% CodeEnhance-gemma-4b + 15% CodeQA + 10% RawTokens (B)=102026.06 | 39 | — | |
| 95% CodeEnhance+CodeQA + 5% RawTokens (B)=102026.06 | 38.4 | — | |
| 95% Nemotron-RW + 5% RawTokens (B)=102026.06 | 37.2 | — | |
| 90% CodeEnhance+CodeQA + 10% RawTokens (B)=102026.06 | 34.2 | — | |
| CodeEnhance-gemma-4bTokens (B)=102026.06 | 33.5 | — | |
| 95% SwallowCode + 5% RawTokens (B)=102026.06 | 32.3 | — | |
| CodeEnhanceTokens (B)=102026.06 | 31.7 | — | |
| CodeEnhance-gemma-1bTokens (B)=102026.06 | 30.5 | — |