Speculative Decoding on Qasper
1.66SRRASD(PLD)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RASD(PLD)model=Qwen2.5-Instruct-14B, Temperature=02025.03 | 1.66 | 2.58 | |
| RASD(PLD)model=LLaMA3-Instruct-8B, Temperature=12025.03 | 1.66 | 3.16 | |
| PLDmodel=Qwen2.5-Instruct-14B, Temperature=02025.03 | 1.62 | 1.58 | |
| RASD(PLD)model=Qwen2.5-Instruct-14B, Temperature=12025.03 | 1.6 | 2.48 | |
| RASD(PLD)model=LLaMA3-Instruct-8B, Temperature=02025.03 | 1.59 | 2.84 | |
| PLDmodel=Qwen2.5-Instruct-14B, Temperature=12025.03 | 1.54 | 1.53 | |
| PLDmodel=LLaMA3-Instruct-8B, Temperature=12025.03 | 1.53 | 0.95 | |
| EAGLE2model=LLaMA3-Instruct-8B, Temperature=12025.03 | 1.53 | 2.61 | |
| EAGLE2model=LLaMA3-Instruct-8B, Temperature=02025.03 | 1.52 | 2.36 | |
| EAGLE2model=Qwen2.5-Instruct-14B, Temperature=02025.03 | 1.48 | 1.83 | |
| PLDmodel=LLaMA3-Instruct-8B, Temperature=02025.03 | 1.46 | 1.04 | |
| EAGLE2model=Qwen2.5-Instruct-14B, Temperature=12025.03 | 1.39 | 1.76 |