Mathematical Reasoning on GSM8K (Throughput, Latency, Score)
12.37Throughputd2Cache
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| d2CacheBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 12.37 | 21.74 | 73.5 | |
| d2CacheBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 11.37 | 22.57 | 72.1 | |
| Fast-dLLMBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 10.07 | 25.44 | 71.4 | |
| Fast-dLLMBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 9.94 | 25.82 | 70.3 | |
| dLLM-CacheBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 9.28 | 27.88 | 64.7 | |
| dLLM-CacheBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 7.72 | 33.3 | 69.3 | |
| VanillaBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 2.67 | 96.29 | 71.7 | |
| VanillaBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 2.31 | 112.39 | 70.4 |