Code Generation on HEval
68.29Pass@1Temporal Guidance
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Temporal GuidanceBackbone=Qwen3-8B, Alpha=0.12026.01 | 68.29 | — | — | — | |
| Temporal GuidanceBackbone=Qwen3-8B, Alpha=0.22026.01 | 67.07 | — | — | — | |
| DoLaBackbone=Qwen3-8B, Penalty=1.02026.01 | 66.46 | — | — | — | |
| DoLaBackbone=Qwen3-8B, Penalty=1.22026.01 | 66.46 | — | — | — | |
| Temporal GuidanceBackbone=Qwen3-8B, Alpha=0.42026.01 | 65.24 | — | — | — | |
| Temporal GuidanceBackbone=Qwen3-8B, Alpha=0.32026.01 | 64.63 | — | — | — | |
| Temporal GuidanceBackbone=Qwen3-8B, Alpha=0.52026.01 | 64.63 | — | — | — | |
| Baseline (Greedy)Backbone=Qwen3-8B2026.01 | 63.41 | — | — | — | |
| Contrastive DecodingBackbone=Qwen3-8B, Amateur Model=Qwen3-1.7B2026.01 | 61.58 | — | — | — | |
| Contrastive DecodingBackbone=Qwen3-8B, Amateur Model=Qwen3-0.6B2026.01 | 53.65 | — | — | — | |
| Temporal GuidanceBackbone=Qwen3-1.7B, Alpha=0.22026.01 | 42.07 | — | — | — | |
| Temporal GuidanceBackbone=Qwen3-1.7B, Alpha=0.12026.01 | 41.46 | — | — | — | |
| Baseline (Greedy)Backbone=Qwen3-1.7B2026.01 | 40.24 | — | — | — | |
| Contrastive DecodingBackbone=Qwen3-1.7B, Amateur Model=Qwen3-0.6B2026.01 | 39.02 | — | — | — | |
| Temporal GuidanceBackbone=Llama-3.2-3B, Alpha=0.12026.01 | 32.32 | — | — | — | |
| Temporal GuidanceBackbone=Llama-3.2-3B, Alpha=0.22026.01 | 31.71 | — | — | — | |
| DoLaBackbone=Llama-3.2-3B, Penalty=1.22026.01 | 29.27 | — | — | — | |
| DoLaBackbone=Qwen3-1.7B, Penalty=1.22026.01 | 28.05 | — | — | — | |
| Baseline (Greedy)Backbone=Llama-3.2-3B2026.01 | 27.44 | — | — | — | |
| DoLaBackbone=Llama-3.2-3B, Penalty=1.02026.01 | 26.22 | — | — | — | |
| DoLaBackbone=Qwen3-1.7B, Penalty=1.02026.01 | 20.73 | — | — | — | |
| DAEDALFine-tuned=No, Expansion Signal=[EOS], Initial canvas=short2026.06 | — | 44.51 | 254.66 | 1 | |
| LLaDA fixed-64Fine-tuned=No, Expansion Signal=None, Initial canvas=short2026.06 | — | 29.27 | — | — | |
| VOID fixed-64Fine-tuned=Yes, Expansion Signal=None, Initial canvas=short2026.06 | — | 36.59 | — | — | |
| VoidExpansionFine-tuned=Yes, Expansion Signal=[VOID], Initial canvas=short2026.06 | — | 42.07 | 73.06 | 5.59 | |
| ρ-[EOS]Fine-tuned=No, Expansion Signal=[EOS], Initial canvas=short2026.06 | — | 40.24 | 191.52 | 1.34 |