Code Generation on HumanEval (Latency, NFE, Accuracy)
2Latency (s)LocalLeap
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LocalLeapModel=LLaDA-1.5-8B2026.05 | 2 | 75.8 | 42.07 | |
| BlockBatchModel=LLaDA-Instruct-8B2026.05 | 2 | 64.6 | 38.41 | |
| BlockBatchModel=LLaDA-1.5-8B2026.05 | 2.1 | 63 | 39.63 | |
| LocalLeapModel=LLaDA-Instruct-8B2026.05 | 2.1 | 69.8 | 35.98 | |
| Fast-dLLMModel=LLaDA-Instruct-8B2026.05 | 2.6 | 90.4 | 36.59 | |
| LocalLeapModel=Dream-Base-7B2026.05 | 2.6 | 123.9 | 48.78 | |
| BlockBatchModel=Dream-Base-7B2026.05 | 2.8 | 112.5 | 52.44 | |
| Fast-dLLMModel=Dream-Base-7B2026.05 | 3.1 | 156.1 | 52.44 | |
| Fast-dLLMModel=LLaDA-1.5-8B2026.05 | 4.3 | 88.7 | 39.02 | |
| VanillaModel=Dream-Base-7B2026.05 | 4.7 | 256 | 50 | |
| VanillaModel=LLaDA-Instruct-8B2026.05 | 5.7 | 256 | 40.24 | |
| VanillaModel=LLaDA-1.5-8B2026.05 | 5.77 | 256 | 43.29 |