Python Code Generation on HumanEval (Pass@1)
39.6Pass@1YOCO (Dense)
Evaluation Results
| Method | Links | |
|---|---|---|
| YOCO (Dense)Model Scale=4B2026.06 | 39.6 | |
| YOCO (CLSA)Model Scale=4B, Attention=Cross-Layer Sparse2026.06 | 39.6 | |
| TransformerModel Scale=4B2026.06 | 38.4 | |
| DynamicModel=Qwen2.5-Coder-1.5B-Instruct, Fine-tuning method=dynamic constraints, Evaluation framework=bigcode-evaluation-harness2026.03 | 20.7 | |
| DAPOModel=Qwen2.5-Coder-1.5B-Instruct, Fine-tuning method=DAPO, Evaluation framework=bigcode-evaluation-harness2026.03 | 18 | |
| Qwen2.5-Coder-1.5B-InstructEvaluation framework=bigcode-evaluation-harness2026.03 | 12.8 |