Speculative Decoding on Average Code, Law, Med
133.31Throughput (tokens/s)EvoSpec
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EvoSpecStatic Vocabulary Size=32k, Dynamic Buffer Size (Dyna)=2562026.04 | 133.31 | 1.16 | |
| EvoSpecStatic Vocabulary Size=32k, Dynamic Buffer Size (Dyna)=5122026.04 | 132.88 | 1.16 | |
| EvoSpecStatic Vocabulary Size=32k, Dynamic Buffer Size (Dyna)=10242026.04 | 132.39 | 1.16 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Buffer Size (Dyna)=10242026.04 | 127.49 | 1.11 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Buffer Size (Dyna)=5122026.04 | 124.03 | 1.08 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Buffer Size (Dyna)=2562026.04 | 120.51 | 1.05 | |
| FR-SpecStatic Vocabulary Size=32k2026.04 | 117.43 | 1.03 | |
| Vanilla SD2026.04 | 114.56 | 1 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Buffer Size (Dyna)=10242026.04 | 111.34 | 0.97 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Buffer Size (Dyna)=5122026.04 | 109.17 | 0.95 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Buffer Size (Dyna)=2562026.04 | 106.39 | 0.93 |