Code Generation on MBPP (Acc(%), TPS)
60Accuracy (%)Dream
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DreamPrompting Protocol=3-shot, Block Size=2562026.06 | 60 | 5.48 | |
| DreamPrompting Protocol=3-shot, Block Size=5122026.06 | 59.4 | 2.14 | |
| DreamPrompting Protocol=3-shot, Block Size=10242026.06 | 58.1 | 0.95 | |
| Fast-dLLM-DreamPrompting Protocol=3-shot, Block Size=2562026.06 | 56.4 | 23.86 | |
| Fast-dLLM-DreamPrompting Protocol=3-shot, Block Size=5122026.06 | 54.8 | 16.99 | |
| AsyncLane-DreamPrompting Protocol=3-shot, Block Size=5122026.06 | 54.6 | 89.76 | |
| Fast-dLLM-DreamPrompting Protocol=3-shot, Block Size=10242026.06 | 54.4 | 9.79 | |
| AsyncLane-DreamPrompting Protocol=3-shot, Block Size=2562026.06 | 54.4 | 89.69 | |
| AsyncLane-DreamPrompting Protocol=3-shot, Block Size=10242026.06 | 54.3 | 90.44 | |
| d3LLM-TF-DreamPrompting Protocol=3-shot, Block Size=5122026.06 | 49.2 | 68.18 | |
| d3LLM-TF-DreamPrompting Protocol=3-shot, Block Size=2562026.06 | 48.2 | 68.31 | |
| d3LLM-TF-DreamPrompting Protocol=3-shot, Block Size=10242026.06 | 48.2 | 45.81 |