Code Generation on MBPP EvalPlus (base and plus)
46.8Base Pass RateFast-dLLM-v2 (1.5B)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Fast-dLLM-v2 (1.5B)Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 46.8 | 39.7 | 133 | |
| RelayBackbone=Fast-dLLM-v2 (1.5B), Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 46.6 | 41.5 | 78.8 | |
| Vanilla SFTBackbone=Fast-dLLM-v2 (1.5B), Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 43.9 | 38.1 | 84.8 | |
| Relay (sg)Backbone=Fast-dLLM-v2 (1.5B), Confidence threshold (τ)=0.85, Block length=32, Sub-block length=8, Top-p=0.95, Temperature=02026.05 | 43.1 | 39.2 | 80.1 |