Mathematical Reasoning on Math-500 (Throughput, Latency, Score)
13.86Throughputd2Cache
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| d2CacheBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 13.86 | 18.63 | 39.6 | |
| d2CacheBackbone=Dream-Inst, n-shot=4-shot, Generation Length=2562025.09 | 13.8 | 18.8 | 44.6 | |
| d2CacheBackbone=LLaDA-Inst, n-shot=4-shot, Generation Length=2562025.09 | 12.02 | 20.19 | 38 | |
| Fast-dLLMBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 10.93 | 23.41 | 27 | |
| d2CacheBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 10.8 | 20.13 | 30.4 | |
| Fast-dLLMBackbone=Dream-Inst, n-shot=4-shot, Generation Length=2562025.09 | 10.72 | 23.52 | 44.4 | |
| Fast-dLLMBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 10.69 | 23.94 | 39.4 | |
| Fast-dLLMBackbone=LLaDA-Inst, n-shot=4-shot, Generation Length=2562025.09 | 10.61 | 23.79 | 38 | |
| dLLM-CacheBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 9.83 | 25.94 | 29.6 | |
| dLLM-CacheBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 9.7 | 26.08 | 35.2 | |
| dLLM-CacheBackbone=Dream-Inst, n-shot=4-shot, Generation Length=2562025.09 | 7.19 | 35.36 | 44.2 | |
| dLLM-CacheBackbone=LLaDA-Inst, n-shot=4-shot, Generation Length=2562025.09 | 6.71 | 37.84 | 38.2 | |
| VanillaBackbone=Dream-Base, Few-shot=4-shot, Generation Length=2562025.09 | 3.55 | 71.54 | 39 | |
| VanillaBackbone=Dream-Inst, n-shot=4-shot, Generation Length=2562025.09 | 3.51 | 71.05 | 45.2 | |
| VanillaBackbone=LLaDA-Base, Few-shot=4-shot, Generation Length=2562025.09 | 3.14 | 80.44 | 32.2 | |
| VanillaBackbone=LLaDA-Inst, n-shot=4-shot, Generation Length=2562025.09 | 3.08 | 82.51 | 38.4 |