Speculative Decoding Performance on CNN/DM, GSM8K, and HumanEval Aggregate
3.04MATLogitSpec
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LogitSpecModels=Llama 2 13B2025.07 | 3.04 | 2.46 | |
| LogitSpecModels=Llama 2 7B2025.07 | 3.01 | 2.48 | |
| LogitSpecModels=Llama 2 70B2025.07 | 2.46 | 1.97 | |
| SpSModels=Llama 2 13B2025.07 | 2.38 | 1.65 | |
| SpSModels=Llama 2 7B2025.07 | 2.32 | 1.61 | |
| PLDModels=Llama 2 13B2025.07 | 2.29 | 1.9 | |
| PLDModels=Llama 2 7B2025.07 | 2.26 | 2.04 | |
| SpSModels=Llama 2 70B2025.07 | 2.07 | 1.7 | |
| LookaheadModels=Llama 2 13B2025.07 | 1.83 | 1.45 | |
| LookaheadModels=Llama 2 7B2025.07 | 1.79 | 1.52 | |
| LookaheadModels=Llama 2 70B2025.07 | 1.76 | 1.47 | |
| RESTModels=Llama 2 70B2025.07 | 1.75 | 1.44 | |
| PLDModels=Llama 2 70B2025.07 | 1.74 | 1.56 | |
| RESTModels=Llama 2 7B2025.07 | 1.73 | 1.34 | |
| RESTModels=Llama 2 13B2025.07 | 1.73 | 1.41 |