Mathematical Reasoning on GSM8K (test) (Accuracy, Throughput, Speedup)
5.6Relative SpeedupWindow-Diffusion
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Window-DiffusionModel=LLaDA-Base, #Shots=4, Max generation length=256, external window length=64, internal window length=16, cache refresh interval=32, early stopping=disabled2026.01 | 5.6 | 68.5 | 25.14 | |
| Fast-dLLM (Dual-Cache)Model=LLaDA-Base, #Shots=4, Max generation length=256, block size=32, parallel decoding=disabled2026.01 | 3.85 | 67.9 | 17.28 | |
| Fast-dLLM (Prefix-Cache)Model=LLaDA-Base, #Shots=4, Max generation length=256, block size=32, parallel decoding=disabled2026.01 | 3.28 | 68.8 | 14.71 | |
| Drafter5Drafter Specialization=5: Math2026.04 | 2.454 | — | — | |
| MetaSpS-UCBBandit Selection=UCB2026.04 | 2.28 | — | — | |
| MetaSpS-SHBandit Selection=SH2026.04 | 2.144 | — | — | |
| DKV-CacheModel=LLaDA-Base, #Shots=4, Max generation length=256, cache refresh interval=8, block size=322026.01 | 1.8 | 68.7 | 8.07 | |
| MetaSpS-EXP3Bandit Selection=EXP32026.04 | 1.69 | — | — | |
| PLDMethod Type=Other2026.04 | 1.653 | — | — | |
| OFADrafter Type=One-Size-Fits-All2026.04 | 1.571 | — | — | |
| LookaheadMethod Type=Other2026.04 | 1.533 | — | — | |
| Drafter4Drafter Specialization=4: QA2026.04 | 1.486 | — | — | |
| Drafter1Drafter Specialization=1: Code2026.04 | 1.483 | — | — | |
| MetaSpS-RandBandit Selection=Rand2026.04 | 1.471 | — | — | |
| Drafter3Drafter Specialization=3: Summarization2026.04 | 1.378 | — | — | |
| Drafter2Drafter Specialization=2: Translation2026.04 | 1.228 | — | — | |
| LLaDAModel=LLaDA-Base, #Shots=4, Max generation length=2562026.01 | 1 | 70.7 | 4.49 |