Efficiency (Speedup) on GSM8k (test)
2.14SpeedupGSD
Evaluation results
| Method | Links | |
|---|---|---|
| GSDBase Model=LLaMA-2-70b, Decoding Protocol=non-deterministic speculative decoding2024.07 | 2.14 | |
| MedusaBackbone=LLaMA-2-70b2024.07 | 2.01 | |
| GSDBackbone=LLaMA-2-70b2024.07 | 1.96 | |
| TSDBase Model=LLaMA-2-70b, Decoding Protocol=non-deterministic speculative decoding2024.07 | 1.81 | |
| SSDBase Model=LLaMA-2-70b, Decoding Protocol=non-deterministic speculative decoding2024.07 | 1.8 |