Code Generation on LiveCodeBench v5 (avg@8 accuracy)
62.2Avg@8 AccuracyBF16 (Teacher)
Evaluation results
| Method | Links | |
|---|---|---|
| BF16 (Teacher)Model=Qwen3-4B-Thinking-2507, Precision=BF162026.06 | 62.2 | |
| CKA-QADModel=Qwen3-4B-Thinking-2507, Precision=NVFP42026.06 | 59.8 | |
| QAD (KL-only)Model=Qwen3-4B-Thinking-2507, Precision=NVFP42026.06 | 57.9 | |
| NVFP4 PTQModel=Qwen3-4B-Thinking-2507, Precision=NVFP42026.06 | 55.4 |