Code Generation on MBPP (Accuracy, TPS, Speedup)
57.2AccuracySTDD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| STDDBackbone=Dream-7B2025.12 | 57.2 | 29.7 | 2.91 | |
| ConfidenceBackbone=Dream-7B2025.12 | 56.6 | 10.2 | 1 | |
| Fast-dLLMBackbone=Dream-7B2025.12 | 53.8 | 30.2 | 2.96 | |
| DUSBackbone=Dream-7B, B=82025.12 | 46.4 | 27.3 | 2.68 | |
| ConfidenceBackbone=LLaDA-8B2025.12 | 29.4 | 5.4 | 1 | |
| DUSBackbone=LLaDA-8B, B=82025.12 | 29.2 | 14.6 | 2.7 | |
| Fast-dLLMBackbone=LLaDA-8B2025.12 | 28.4 | 22.4 | 4.15 | |
| STDDBackbone=LLaDA-8B2025.12 | 28.2 | 48.1 | 8.9 |