Code Generation on MBPP (3-shot, pass@1)
25.6AccuracyFast-dLLM (threshold)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Fast-dLLM (threshold)Generation Length=2562025.12 | 25.6 | 73.15 | 1 | |
| CadLLMGeneration Length=2562025.12 | 24 | 99.86 | 1.37 | |
| Fast-dLLM (factor)Generation Length=2562025.12 | 21.2 | 96.01 | 1.31 | |
| Fast-dLLM (threshold)Generation Length=5122025.12 | 14.2 | 77.71 | 1 | |
| Fast-dLLM (factor)Generation Length=5122025.12 | 13.2 | 100.73 | 1.3 | |
| CadLLMGeneration Length=5122025.12 | 13 | 104.62 | 1.35 |