Code Generation on HumanEval (Acc, Step)
59.76AccuracyKLASS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KLASSModel=Dream2025.11 | 59.76 | 73.73 | |
| Top-k MarginModel=Dream2025.11 | 58.53 | 256 | |
| EntropyModel=Dream2025.11 | 58.53 | 256 | |
| Top-k MarginModel=Dream2025.11 | 43.29 | 128 | |
| EntropyModel=Dream2025.11 | 43.29 | 128 | |
| KLASSModel=LLaDA2025.11 | 40.85 | 91.98 | |
| Top-k MarginModel=LLaDA2025.11 | 39.63 | 256 | |
| EntropyModel=LLaDA2025.11 | 35.97 | 256 | |
| Top-k MarginModel=LLaDA2025.11 | 30.48 | 128 | |
| EntropyModel=LLaDA2025.11 | 25.6 | 128 |