Code Generation on LCB v6 (Pass@1)
50.68Pass@1BDR-16
Evaluation Results
| Method | Links | |
|---|---|---|
| BDR-16Model=GLM-4.7 (358B)2026.04 | 50.68 | |
| BDR-128Model=GLM-4.7 (358B)2026.04 | 50.49 | |
| BDR-64Model=GLM-4.7 (358B)2026.04 | 49.9 | |
| BF16Model=GLM-4.7 (358B)2026.04 | 49.12 | |
| BF16Model=Qwen3-8B2026.04 | 49.01 | |
| BDR-128Model=Qwen3-8B2026.04 | 47.95 | |
| BDR-64Model=Qwen3-8B2026.04 | 47.48 | |
| BDR-16Model=Qwen3-8B2026.04 | 47.13 | |
| BDR-64 (K)Model=Qwen3-8B2026.04 | 47.02 | |
| INT4Model=GLM-4.7 (358B)2026.04 | 45.81 | |
| Lightning OPDStudent=Qwen3-8B-Base, Teacher=Qwen3-32B2026.04 | 43.9 | |
| OPDStudent=Qwen3-8B-Base, Teacher=Qwen3-32B2026.04 | 41.2 | |
| Lightning OPDStudent=Qwen3-4B-Base, Teacher=Qwen3-8B2026.04 | 40.3 | |
| OPDStudent=Qwen3-4B-Base, Teacher=Qwen3-8B2026.04 | 39.3 | |
| SFTStudent=Qwen3-8B-Base, Teacher=Qwen3-32B2026.04 | 36.8 | |
| SFTStudent=Qwen3-4B-Base, Teacher=Qwen3-8B2026.04 | 31.5 | |
| ExOPDStudent=Qwen3-4B-Base, Teacher=Qwen3-8B2026.04 | 29 | |
| PriFT-massBackbone=Qwen2.5-Coder-3B2026.06 | 21.14 | |
| OriginalBackbone=Qwen2.5-Coder-3B2026.06 | 20.47 | |
| ASFTBackbone=Qwen2.5-Coder-3B2026.06 | 20.09 | |
| PriFT-probBackbone=Qwen2.5-Coder-3B2026.06 | 16.78 | |
| EAFTBackbone=Qwen2.5-Coder-3B2026.06 | 16.59 | |
| SFTBackbone=Qwen2.5-Coder-3B2026.06 | 16.02 | |
| IDFTBackbone=Qwen2.5-Coder-3B2026.06 | 15.45 | |
| BaseModel=Qwen2.5-7B-Instruct2026.05 | 13.71 | |
| SimCTTeacher=Qwen2.5-7B-Instruct, Student=Phi-4-mini-instruct2026.05 | 12.57 | |
| DFTBackbone=Qwen2.5-Coder-3B2026.06 | 12.13 | |
| GOLDTeacher=Qwen2.5-7B-Instruct, Student=Phi-4-mini-instruct2026.05 | 12.06 | |
| TALRBackbone=Qwen2.5-Coder-3B2026.06 | 11.85 | |
| DSKDTeacher=Qwen2.5-7B-Instruct, Student=Phi-4-mini-instruct2026.05 | 11.43 | |
| ALMTeacher=Qwen2.5-7B-Instruct, Student=Phi-4-mini-instruct2026.05 | 10.86 | |
| SimpleOPDTeacher=Qwen2.5-7B-Instruct, Student=Phi-4-mini-instruct2026.05 | 9.23 | |
| SFTTeacher=Qwen2.5-7B-Instruct, Student=Phi-4-mini-instruct2026.05 | 8.57 | |
| BaseModel=Phi-4-mini-instruct2026.05 | 7.92 | |
| SimCTTeacher=Qwen2.5-7B-Instruct, Student=Gemma-2-2B-it2026.05 | 7.29 | |
| SimCTTeacher=Phi-4-mini-instruct, Student=Gemma-2-2B-it2026.05 | 7.14 | |
| SimpleOPDTeacher=Qwen2.5-7B-Instruct, Student=Gemma-2-2B-it2026.05 | 7.01 | |
| DSKDTeacher=Qwen2.5-7B-Instruct, Student=Gemma-2-2B-it2026.05 | 6.86 | |
| GOLDTeacher=Qwen2.5-7B-Instruct, Student=Gemma-2-2B-it2026.05 | 6.82 | |
| SFTTeacher=Qwen2.5-7B-Instruct, Student=Gemma-2-2B-it2026.05 | 6.77 | |
| ALMTeacher=Qwen2.5-7B-Instruct, Student=Gemma-2-2B-it2026.05 | 6.71 | |
| BaseModel=Gemma-2-2B-it2026.05 | 6.65 | |
| ALMTeacher=Phi-4-mini-instruct, Student=Gemma-2-2B-it2026.05 | 6.63 | |
| GOLDTeacher=Phi-4-mini-instruct, Student=Gemma-2-2B-it2026.05 | 6.57 | |
| DSKDTeacher=Phi-4-mini-instruct, Student=Gemma-2-2B-it2026.05 | 6.57 | |
| SFTTeacher=Phi-4-mini-instruct, Student=Gemma-2-2B-it2026.05 | 6.43 | |
| SimpleOPDTeacher=Phi-4-mini-instruct, Student=Gemma-2-2B-it2026.05 | 6.43 | |
| INT4Model=Qwen3-8B2026.04 | 0 |