Code Generation on HumanEval (Throughput, Latency, Score)
14.36Throughputd2Cache
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| d2CacheBackbone=LLaDA-Base, Few-shot=0-shot, Generation Length=5122025.09 | 14.36 | 35.6 | 33.5 | |
| d2CacheBackbone=Dream-Base, Few-shot=0-shot, Generation Length=5122025.09 | 14.36 | 37.18 | 61 | |
| dLLM-CacheBackbone=LLaDA-Base, Few-shot=0-shot, Generation Length=5122025.09 | 9.04 | 55.6 | 31.7 | |
| Fast-dLLMBackbone=LLaDA-Base, Few-shot=0-shot, Generation Length=5122025.09 | 8.13 | 62.96 | 31.7 | |
| Fast-dLLMBackbone=Dream-Base, Few-shot=0-shot, Generation Length=5122025.09 | 7.81 | 88.02 | 53.7 | |
| dLLM-CacheBackbone=Dream-Base, Few-shot=0-shot, Generation Length=5122025.09 | 5.47 | 91.72 | 51.8 | |
| VanillaBackbone=Dream-Base, Few-shot=0-shot, Generation Length=5122025.09 | 5.45 | 92.11 | 51.2 | |
| VanillaBackbone=LLaDA-Base, Few-shot=0-shot, Generation Length=5122025.09 | 5.02 | 100.54 | 32.3 |