Speculative Decoding on Qa
2.23SpeedupGriffin+LTD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Griffin+LTDBackbone=Meta-Llama-3-8B-Instruct, Decoding Strategy=greedy decoding2026.03 | 2.23 | 4.1 | |
| GriffinBackbone=Meta-Llama-3-8B-Instruct, Decoding Strategy=greedy decoding2026.03 | 2.2 | 3.96 | |
| Griffin+GSBackbone=Meta-Llama-3-8B-Instruct, Decoding Strategy=greedy decoding2026.03 | 2.18 | 4.1 |