Text Generation on Spec-Bench Overall
2.33SD ScoreSpecBound
Evaluation Results
| Method | Links | |
|---|---|---|
| SpecBoundBase Model=Codellama-13B-Instruct2026.04 | 2.33 | |
| SpecBoundBase Model=Vicuna-13B2026.04 | 2.16 | |
| SpecBoundBase Model=Vicuna-7B2026.04 | 2.15 | |
| SpecBoundBase Model=Codellama-7B-Instruct2026.04 | 1.93 | |
| MedusaBase Model=Vicuna-13B2026.04 | 1.81 | |
| MedusaBase Model=Codellama-13B-Instruct2026.04 | 1.81 | |
| MedusaBase Model=Vicuna-7B2026.04 | 1.71 | |
| MedusaBase Model=Codellama-7B-Instruct2026.04 | 1.7 | |
| AdaDecodeBase Model=Codellama-13B-Instruct2026.04 | 1.52 | |
| KangarooBase Model=Vicuna-7B2026.04 | 1.5 | |
| RESTBase Model=Vicuna-7B2026.04 | 1.47 | |
| RESTBase Model=Codellama-7B-Instruct2026.04 | 1.47 | |
| SPACEBase Model=Vicuna-7B2026.04 | 1.46 | |
| AdaDecodeBase Model=Codellama-7B-Instruct2026.04 | 1.45 | |
| KangarooBase Model=Vicuna-13B2026.04 | 1.44 | |
| RESTBase Model=Codellama-13B-Instruct2026.04 | 1.39 | |
| RESTBase Model=Vicuna-13B2026.04 | 1.37 | |
| LookaheadBase Model=Vicuna-7B2026.04 | 1.35 | |
| LookaheadBase Model=Codellama-7B-Instruct2026.04 | 1.33 | |
| LookaheadBase Model=Codellama-13B-Instruct2026.04 | 1.31 | |
| LookaheadBase Model=Vicuna-13B2026.04 | 1.3 |