Code Generation on HumanEval (Acc, TPS)
56.7AccuracyFast-dLLM-Dream
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Fast-dLLM-DreamPrompting Protocol=0-shot, Block Size=2562026.06 | 56.7 | 68.25 | |
| Fast-dLLM-DreamPrompting Protocol=0-shot, Block Size=10242026.06 | 56.7 | 31.28 | |
| Fast-dLLM-DreamPrompting Protocol=0-shot, Block Size=5122026.06 | 54.87 | 54.3 | |
| AsyncLane-DreamPrompting Protocol=0-shot, Block Size=2562026.06 | 53.05 | 126 | |
| d3LLM-TF-DreamPrompting Protocol=0-shot, Block Size=5122026.06 | 53.04 | 79.51 | |
| AsyncLane-DreamPrompting Protocol=0-shot, Block Size=10242026.06 | 52.44 | 121.72 | |
| AsyncLane-DreamPrompting Protocol=0-shot, Block Size=5122026.06 | 51.83 | 115.03 | |
| d3LLM-TF-DreamPrompting Protocol=0-shot, Block Size=10242026.06 | 51.82 | 51.66 | |
| d3LLM-TF-DreamPrompting Protocol=0-shot, Block Size=2562026.06 | 50.6 | 105.69 | |
| DreamPrompting Protocol=0-shot, Block Size=5122026.06 | 47.79 | 4.24 | |
| DreamPrompting Protocol=0-shot, Block Size=10242026.06 | 47.65 | 1.7 | |
| DreamPrompting Protocol=0-shot, Block Size=2562026.06 | 47.56 | 9.7 |