Speculative Decoding on MultiFieldQA
2.1Speculative Rate (SR)RASD(PLD)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RASD(PLD)model=Qwen2.5-Instruct-14B, Temperature=02025.03 | 2.1 | 2.78 | |
| PLDmodel=Qwen2.5-Instruct-14B, Temperature=02025.03 | 1.98 | 1.6 | |
| RASD(PLD)model=LLaMA3-Instruct-8B, Temperature=02025.03 | 1.98 | 2.86 | |
| RASD(PLD)model=Qwen2.5-Instruct-14B, Temperature=12025.03 | 1.93 | 2.29 | |
| PLDmodel=LLaMA3-Instruct-8B, Temperature=02025.03 | 1.9 | 1.39 | |
| RASD(PLD)model=LLaMA3-Instruct-8B, Temperature=12025.03 | 1.82 | 2.88 | |
| PLDmodel=LLaMA3-Instruct-8B, Temperature=12025.03 | 1.81 | 1.45 | |
| PLDmodel=Qwen2.5-Instruct-14B, Temperature=12025.03 | 1.72 | 1.25 | |
| EAGLE2model=LLaMA3-Instruct-8B, Temperature=02025.03 | 1.68 | 2.28 | |
| EAGLE2model=Qwen2.5-Instruct-14B, Temperature=02025.03 | 1.65 | 1.73 | |
| EAGLE2model=LLaMA3-Instruct-8B, Temperature=12025.03 | 1.6 | 2.35 | |
| EAGLE2model=Qwen2.5-Instruct-14B, Temperature=12025.03 | 1.56 | 1.61 |