Code Generation on HumanEval (Pass@1, Speedup)
0.598Pass@1KLASS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KLASSBackbone=Dream-7B2026.02 | 0.598 | 7.92 | |
| Full DecodingBackbone=Dream-7B2026.02 | 0.591 | 1 | |
| JotBackbone=Dream-7B2026.02 | 0.585 | 19.6 | |
| ProphetBackbone=Dream-7B2026.02 | 0.567 | 9.17 | |
| Full DecodingBackbone=LLaDA-8B2026.02 | 0.476 | 1 | |
| JotBackbone=LLaDA-8B2026.02 | 0.445 | 2.12 | |
| ProphetBackbone=LLaDA-8B2026.02 | 0.409 | 1.89 | |
| KLASSBackbone=LLaDA-8B2026.02 | 0.402 | 2.53 |