Speculative Decoding on Pile of Law
181.91Inference Speed (tokens/s)EvoSpec
Evaluation results
| Method | Links | |
|---|---|---|
| EvoSpecStatic Vocabulary Size=32k, Dynamic Expansion Size=5122026.04 | 181.91 | |
| EvoSpecStatic Vocabulary Size=32k, Dynamic Expansion Size=2562026.04 | 181.32 | |
| EvoSpecStatic Vocabulary Size=32k, Dynamic Expansion Size=10242026.04 | 179.23 | |
| CORAL2026.04 | 176.31 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Expansion Size=5122026.04 | 164.56 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Expansion Size=2562026.04 | 162.04 | |
| EvoSpecStatic Vocabulary Size=16k, Dynamic Expansion Size=10242026.04 | 162.01 | |
| EAGLE-32026.04 | 160.66 | |
| FR-SpecStatic Vocabulary Size=32k2026.04 | 160.46 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Expansion Size=10242026.04 | 144.77 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Expansion Size=5122026.04 | 144.06 | |
| EvoSpecStatic Vocabulary Size=8k, Dynamic Expansion Size=2562026.04 | 143.27 |