Multi-path speculative decoding on Gemma held-out (test)
2.17Throughput Ratio ImprovementKhisti NDE
Evaluation results
| Method | Links | |
|---|---|---|
| Khisti NDEVerification algorithm=Khisti, Neural Dynamic Expansion=true2026.02 | 2.17 | |
| SpecTr NDEVerification algorithm=SpecTr, Neural Dynamic Expansion=true2026.02 | 2.17 | |
| SpecInfer NDEVerification algorithm=SpecInfer, Neural Dynamic Expansion=true2026.02 | 2.14 | |
| NSS NDEVerification algorithm=NSS, Neural Dynamic Expansion=true2026.02 | 2.09 | |
| NaiveTree NDEVerification algorithm=NaiveTree, Neural Dynamic Expansion=true2026.02 | 1.4 |