Mathematical Reasoning on GSM8K 4-shot (test)
54.6ThroughputFast-dLLM (Par.+D.C.)
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Fast-dLLM (Par.+D.C.)Shots=4-shot, parallel decoding=true, dual-cache KV=true2025.11 | 54.6 | — | 4.2 | 76.5 | 85 | 230.4 | |
| CDLM-LLaDAShots=4-shot2025.11 | 54.3 | — | 3.3 | 73.9 | 57.7 | 177.3 | |
| d2CacheModel=Dream-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 46.69 | 17.8 | 6.13 | 75.7 | — | — | |
| d2CacheModel=LLaDA-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 38.16 | 13.8 | 7.26 | 76.9 | — | — | |
| dLLM-CacheModel=Dream-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 36 | 13.7 | 8.21 | 74.3 | — | — | |
| Fast-dLLMModel=Dream-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 32.75 | 12.5 | 8.35 | 74.1 | — | — | |
| Fast-dLLM (Par.)Shots=4-shot, parallel decoding=true2025.11 | 26.7 | — | 8.7 | 78.6 | 77.5 | 231.3 | |
| dLLM-CacheModel=LLaDA-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 25.62 | 9.2 | 10.26 | 77 | — | — | |
| Fast-dLLMModel=LLaDA-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 25.15 | 9.1 | 10.65 | 77.6 | — | — | |
| dLLM-CacheShots=4-shot, cache_mode=dLLM-Cache2025.11 | 18.7 | — | 12.3 | 78.5 | 256 | 229.6 | |
| ParallelModel=Dream-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 13.93 | 5.3 | 21.68 | 74.2 | — | — | |
| ParallelModel=LLaDA-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 8.53 | 3.1 | 33.95 | 77.6 | — | — | |
| LLaDA-8B-InstructShots=4-shot2025.11 | 8.2 | — | 28.3 | 77.1 | 256 | 232.1 | |
| VanillaModel=LLaDA-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 2.77 | 1 | 110.26 | 77.6 | — | — | |
| VanillaModel=Dream-Inst, Few-shot=4-shot, Gen. Len.=256, Decoding Strategy=Semi-AR parallel decoding2025.09 | 2.62 | 1 | 85.94 | 76.7 | — | — |