Code Generation on HumanEval (EvalPlus Base and Plus)
42.1Accuracy (Base)Relay
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RelayBackbone=Fast-dLLM-v2 (1.5B), Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 42.1 | 37.2 | 88.3 | |
| Fast-dLLM-v2 (1.5B)Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 38.4 | 35.4 | 178.1 | |
| Vanilla SFTBackbone=Fast-dLLM-v2 (1.5B), Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 38.4 | 34.1 | 130.7 | |
| Relay (sg)Backbone=Fast-dLLM-v2 (1.5B), Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 38.4 | 35.4 | 104.4 |