List your company
ResearchFormerly WizWand

Multi-task Language Understanding on MMLU Pro (Throughput and Latency)

10.12Throughputd2Cache
1.18643.50575.8258.1443Sep 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
d2CacheBackbone=Dream-Inst, n-shot=5-shot, Generation Length=2562025.0910.1225.7746.8
Fast-dLLMBackbone=Dream-Inst, n-shot=5-shot, Generation Length=2562025.099.7427.6945.9
d2CacheBackbone=Dream-Base, Few-shot=5-shot, Generation Length=2562025.099.7126.7344.4
d2CacheBackbone=LLaDA-Inst, n-shot=5-shot, Generation Length=2562025.099.5927.633.1
d2CacheBackbone=LLaDA-Base, Few-shot=5-shot, Generation Length=2562025.099.5827.639.1
Fast-dLLMBackbone=Dream-Base, Few-shot=5-shot, Generation Length=2562025.099.4227.3145.9
Fast-dLLMBackbone=LLaDA-Base, Few-shot=5-shot, Generation Length=2562025.098.9628.8340
Fast-dLLMBackbone=LLaDA-Inst, n-shot=5-shot, Generation Length=2562025.098.912937.1
dLLM-CacheBackbone=Dream-Inst, n-shot=5-shot, Generation Length=2562025.097.8234.0946.5
dLLM-CacheBackbone=Dream-Base, Few-shot=5-shot, Generation Length=2562025.097.4534.8144.6
dLLM-CacheBackbone=LLaDA-Base, Few-shot=5-shot, Generation Length=2562025.096.8637.9637.4
dLLM-CacheBackbone=LLaDA-Inst, n-shot=5-shot, Generation Length=2562025.096.7938.2938.1
VanillaBackbone=Dream-Inst, n-shot=5-shot, Generation Length=2562025.092.15126.3147.9
VanillaBackbone=Dream-Base, Few-shot=5-shot, Generation Length=2562025.092.13127.0846.1
VanillaBackbone=LLaDA-Inst, n-shot=5-shot, Generation Length=2562025.091.76152.6237.5
VanillaBackbone=LLaDA-Base, Few-shot=5-shot, Generation Length=2562025.091.53143.4538.1