Mathematical Reasoning on GSM8K (test) (TPS, Speed, Acc)
79Throughput (TPS)TSPD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TSPDGen Len=512, KV Cache=true2026.05 | 79 | 24.7 | 77.6 | |
| TSPDGen Len=1024, KV Cache=true2026.05 | 64.1 | 58.3 | 78.5 | |
| TSPDGen Len=512, KV Cache=false2026.05 | 45.4 | 14.2 | 77.9 | |
| Learn2PDGen Len=512, KV Cache=false2026.05 | 39.4 | 12.3 | 77.8 | |
| Fast-dLLMGen Len=512, KV Cache=true2026.05 | 35.3 | 11 | 77.2 | |
| TSPDGen Len=1024, KV Cache=false2026.05 | 27.3 | 24.8 | 79.3 | |
| Learn2PDGen Len=1024, KV Cache=false2026.05 | 24.9 | 22.6 | 78.7 | |
| Fast-dLLMGen Len=1024, KV Cache=true2026.05 | 21.6 | 19.6 | 74.7 | |
| VanillaGen Len=512, KV Cache=true2026.05 | 3.2 | 1 | 77.5 | |
| VanillaGen Len=1024, KV Cache=true2026.05 | 1.1 | 1 | 77 |