Code Generation on MBPP (Throughput, Latency, Score)
12.67Throughputd2Cache
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| d2CacheBackbone=Dream-Base, Few-shot=3-shot, Generation Length=5122025.09 | 12.67 | 40.1 | 0.536 | |
| d2CacheBackbone=LLaDA-Base, Few-shot=3-shot, Generation Length=5122025.09 | 8.62 | 43.41 | 0.38 | |
| dLLM-CacheBackbone=Dream-Base, Few-shot=3-shot, Generation Length=5122025.09 | 7.73 | 64.75 | 0.498 | |
| Fast-dLLMBackbone=Dream-Base, Few-shot=3-shot, Generation Length=5122025.09 | 7.07 | 72.4 | 0.526 | |
| Fast-dLLMBackbone=LLaDA-Base, Few-shot=3-shot, Generation Length=5122025.09 | 7 | 73.16 | 0.374 | |
| dLLM-CacheBackbone=LLaDA-Base, Few-shot=3-shot, Generation Length=5122025.09 | 6.52 | 77.2 | 0.386 | |
| VanillaBackbone=Dream-Base, Few-shot=3-shot, Generation Length=5122025.09 | 2.81 | 177.14 | 0.514 | |
| VanillaBackbone=LLaDA-Base, Few-shot=3-shot, Generation Length=5122025.09 | 2.52 | 195.59 | 0.392 |