Translation on Spec-Bench Trans.
6.41CRSpecBound
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SpecBoundBase Model=Vicuna-7B2026.04 | 6.41 | 2.94 | |
| SpecBoundBase Model=Vicuna-13B2026.04 | 5.93 | 2.77 | |
| SpecBoundBase Model=Codellama-7B-Instruct2026.04 | 4.74 | 2.42 | |
| SpecBoundBase Model=Codellama-13B-Instruct2026.04 | 4.02 | 2.56 | |
| AdaDecodeBase Model=Codellama-13B-Instruct2026.04 | 2.6 | 1.65 | |
| AdaDecodeBase Model=Codellama-7B-Instruct2026.04 | 2.4 | 1.52 | |
| SPACEBase Model=Vicuna-7B2026.04 | 1.73 | 1.37 | |
| MedusaBase Model=Codellama-13B-Instruct2026.04 | 1.68 | 1.75 | |
| MedusaBase Model=Vicuna-13B2026.04 | 1.65 | 1.73 | |
| RESTBase Model=Codellama-7B-Instruct2026.04 | 1.62 | 1.35 | |
| RESTBase Model=Vicuna-7B2026.04 | 1.58 | 1.33 | |
| RESTBase Model=Vicuna-13B2026.04 | 1.57 | 1.19 | |
| MedusaBase Model=Vicuna-7B2026.04 | 1.55 | 1.63 | |
| MedusaBase Model=Codellama-7B-Instruct2026.04 | 1.51 | 1.61 | |
| RESTBase Model=Codellama-13B-Instruct2026.04 | 1.46 | 1.13 | |
| KangarooBase Model=Vicuna-13B2026.04 | 1.45 | 1.18 | |
| KangarooBase Model=Vicuna-7B2026.04 | 1.41 | 1.24 | |
| LookaheadBase Model=Codellama-7B-Instruct2026.04 | 1.32 | 1.18 | |
| LookaheadBase Model=Vicuna-7B2026.04 | 1.28 | 1.16 | |
| LookaheadBase Model=Vicuna-13B2026.04 | 1.22 | 1.07 | |
| LookaheadBase Model=Codellama-13B-Instruct2026.04 | 1.18 | 1.05 |