Code Generation on MBPP (Accuracy, Accuracy Gain, Speedup)
54.6AccuracyProphet
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ProphetModel=Dream-7B-Instruct, Decoding Strategy=Prophet, Evaluation Setting=Zero-shot2025.08 | 54.6 | 0.6 | 1.33 | |
| Full-step decodingModel=Dream-7B-Instruct, Decoding Strategy=Full-step, Evaluation Setting=Zero-shot2025.08 | 54 | — | — | |
| Full-step decodingModel=LLaDA-8B-Instruct, Decoding Strategy=Full-step, Evaluation Setting=Zero-shot2025.08 | 37.6 | — | — | |
| ProphetModel=LLaDA-8B-Instruct, Decoding Strategy=Prophet, Evaluation Setting=Zero-shot2025.08 | 37.4 | -0.2 | 1.35 |