Speculative Decoding Inference on Specialized Datasets Aggregate
172.65Average Speed (tokens/s)EvoSpec
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EvoSpecStatic Vocabulary Size=32k, Dynamic Expansion Size=2562026.04 | 172.65 | 1.13 | |
| EvoSpecStatic Vocabulary Size=32k, Dynamic Expansion Size=5122026.04 | 172.15 | 1.13 | |
| EvoSpecStatic Vocabulary Size=32k, Dynamic Expansion Size=10242026.04 | 171.11 | 1.12 | |
| CORAL2026.04 | 168.08 | 1.1 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Expansion Size=5122026.04 | 164.16 | 1.08 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Expansion Size=2562026.04 | 162.84 | 1.07 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Expansion Size=10242026.04 | 162.23 | 1.06 | |
| FR-SpecStatic Vocabulary Size=32k2026.04 | 152.69 | 1 | |
| EAGLE-32026.04 | 152.67 | 1 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Expansion Size=10242026.04 | 148.19 | 0.97 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Expansion Size=5122026.04 | 146.79 | 0.96 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Expansion Size=2562026.04 | 146.28 | 0.96 |