Code Synthesis on MBPP Sanitized (Acc, Steps)
64.59AccuracyKLASS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| KLASSParallel=Yes, Backbone=Dream 7B Instruct2025.11 | 64.59 | 111.24 | |
| Top-1Parallel=No, Backbone=Dream 7B Instruct2025.11 | 63.81 | 256 | |
| KL divergenceParallel=Yes, Backbone=Dream 7B Instruct2025.11 | 62.65 | 108.15 | |
| ConfidenceParallel=Yes, Backbone=Dream 7B Instruct2025.11 | 57.59 | 72.49 | |
| KLASSParallel=Yes, Backbone=LLaDA 8B Instruct2025.11 | 47.86 | 119.59 | |
| ConfidenceParallel=Yes, Backbone=LLaDA 8B Instruct2025.11 | 47.08 | 85.2 | |
| Top-2Parallel=Yes, Backbone=Dream 7B Instruct2025.11 | 47.08 | 128 | |
| Top-1Parallel=No, Backbone=LLaDA 8B Instruct2025.11 | 46.69 | 256 | |
| KL divergenceParallel=Yes, Backbone=LLaDA 8B Instruct2025.11 | 45.53 | 150.47 | |
| Top-2Parallel=Yes, Backbone=LLaDA 8B Instruct2025.11 | 37.74 | 128 | |
| RandomParallel=No, Backbone=LLaDA 8B Instruct2025.11 | 29.18 | 256 | |
| RandomParallel=No, Backbone=Dream 7B Instruct2025.11 | 28.14 | 256 |