Code Generation on HumanEval (Pass@1, Pass@10)
56.7Pass@1Dream
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DreamModel size category=Reference Models (≥7B), Number of parameters=7B2025.09 | 56.7 | 59.2 | |
| LLaDAModel size category=Reference Models (≥7B), Number of parameters=8B2025.09 | 35.4 | 50 | |
| DLM + PAPLModel size category=Compact Models (≤1B), Number of parameters=0.5B2025.09 | 20.8 | 38.4 | |
| DLMModel size category=Compact Models (≤1B), Number of parameters=0.5B2025.09 | 18.5 | 31.1 | |
| AutoregressiveModel size category=Compact Models (≤1B), Number of parameters=1.3B2025.09 | 17 | 34.7 | |
| Edit FlowModel size category=Compact Models (≤1B), Number of parameters=1.3B2025.09 | 12.8 | 24.3 | |
| Uniform X0 + Edit FlowModel size category=Compact Models (≤1B), Number of parameters=1.3B2025.09 | 9.7 | 24.3 | |
| Mask DFMModel size category=Compact Models (≤1B), Number of parameters=1.3B2025.09 | 9.1 | 17.6 |