Speculative Decoding on Alpaca
2.98SpeedupGriffin
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GriffinBackbone=Meta-Llama-3-8B-Instruct, Decoding Strategy=greedy decoding2026.03 | 2.98 | — | 4.79 | |
| Griffin+LTDBackbone=Meta-Llama-3-8B-Instruct, Decoding Strategy=greedy decoding2026.03 | 2.98 | — | 5.01 | |
| Griffin+GSBackbone=Meta-Llama-3-8B-Instruct, Decoding Strategy=greedy decoding2026.03 | 2.95 | — | 5.04 | |
| GSDBackbone=LLaMA-2-7b, k=4, tau=1, theta_prob=0.4, theta_sib=0.12024.07 | 1.34 | 79.3 | — | |
| SSDBackbone=LLaMA-2-7b, k=4, tau=1, theta_prob=0.4, theta_sib=0.12024.07 | 1.16 | 69.5 | — |