Multi-turn Dialogue on Spec-Bench Multi.
3.22CRSpecBound
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SpecBoundBase Model=Vicuna-13B2026.04 | 3.22 | 1.69 | |
| SpecBoundBase Model=Vicuna-7B2026.04 | 3.05 | 1.65 | |
| SpecBoundBase Model=Codellama-7B-Instruct2026.04 | 2.74 | 1.66 | |
| SpecBoundBase Model=Codellama-13B-Instruct2026.04 | 2.69 | 1.85 | |
| KangarooBase Model=Vicuna-13B2026.04 | 2.44 | 1.66 | |
| SPACEBase Model=Vicuna-7B2026.04 | 2.31 | 1.71 | |
| KangarooBase Model=Vicuna-7B2026.04 | 2.22 | 1.68 | |
| AdaDecodeBase Model=Codellama-13B-Instruct2026.04 | 2.2 | 1.52 | |
| RESTBase Model=Codellama-7B-Instruct2026.04 | 2.07 | 1.67 | |
| RESTBase Model=Vicuna-7B2026.04 | 2.04 | 1.65 | |
| AdaDecodeBase Model=Codellama-7B-Instruct2026.04 | 2 | 1.4 | |
| RESTBase Model=Vicuna-13B2026.04 | 1.94 | 1.5 | |
| RESTBase Model=Codellama-13B-Instruct2026.04 | 1.91 | 1.48 | |
| MedusaBase Model=Codellama-13B-Instruct2026.04 | 1.89 | 2.09 | |
| MedusaBase Model=Vicuna-13B2026.04 | 1.86 | 2.07 | |
| LookaheadBase Model=Codellama-7B-Instruct2026.04 | 1.78 | 1.51 | |
| LookaheadBase Model=Vicuna-7B2026.04 | 1.74 | 1.49 | |
| MedusaBase Model=Vicuna-7B2026.04 | 1.72 | 1.95 | |
| MedusaBase Model=Codellama-7B-Instruct2026.04 | 1.68 | 1.92 | |
| LookaheadBase Model=Vicuna-13B2026.04 | 1.64 | 1.41 | |
| LookaheadBase Model=Codellama-13B-Instruct2026.04 | 1.61 | 1.39 |