Code Generation on MBPP (Lat. (s), NFE, ACC (%))
1.7Latency (s)BlockBatch
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BlockBatchModel=LLaDA-Instruct-8B2026.05 | 1.7 | 45.3 | 39.6 | |
| LocalLeapModel=LLaDA-Instruct-8B2026.05 | 1.9 | 56.1 | 41.4 | |
| Fast-dLLMModel=LLaDA-Instruct-8B2026.05 | 2.2 | 68.2 | 38.4 | |
| BlockBatchModel=Dream-Base-7B2026.05 | 2.3 | 81.1 | 52 | |
| BlockBatchModel=LLaDA-1.5-8B2026.05 | 2.6 | 54.5 | 40 | |
| Fast-dLLMModel=Dream-Base-7B2026.05 | 2.6 | 111.9 | 53.2 | |
| LocalLeapModel=LLaDA-1.5-8B2026.05 | 2.7 | 58 | 40.2 | |
| LocalLeapModel=Dream-Base-7B2026.05 | 2.9 | 82.8 | 54.6 | |
| Fast-dLLMModel=LLaDA-1.5-8B2026.05 | 4.2 | 76.1 | 38 | |
| VanillaModel=Dream-Base-7B2026.05 | 8 | 256 | 55.8 | |
| VanillaModel=LLaDA-1.5-8B2026.05 | 9.5 | 256 | 43.4 | |
| VanillaModel=LLaDA-Instruct-8B2026.05 | 9.9 | 256 | 41.4 |