Mathematical Reasoning on Spec-Bench Math
4.09CRSpecBound
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SpecBoundBase Model=Vicuna-13B2026.04 | 4.09 | 1.91 | |
| SpecBoundBase Model=Vicuna-7B2026.04 | 3.78 | 1.89 | |
| SpecBoundBase Model=Codellama-7B-Instruct2026.04 | 3.63 | 2.02 | |
| SpecBoundBase Model=Codellama-13B-Instruct2026.04 | 3.49 | 2.2 | |
| KangarooBase Model=Vicuna-13B2026.04 | 2.42 | 1.63 | |
| AdaDecodeBase Model=Codellama-13B-Instruct2026.04 | 2.4 | 1.75 | |
| AdaDecodeBase Model=Codellama-7B-Instruct2026.04 | 2.2 | 1.62 | |
| SPACEBase Model=Vicuna-7B2026.04 | 2.15 | 1.65 | |
| KangarooBase Model=Vicuna-7B2026.04 | 2.14 | 1.61 | |
| LookaheadBase Model=Codellama-13B-Instruct2026.04 | 2.02 | 1.63 | |
| LookaheadBase Model=Vicuna-13B2026.04 | 1.98 | 1.61 | |
| LookaheadBase Model=Vicuna-7B2026.04 | 1.92 | 1.54 | |
| LookaheadBase Model=Codellama-7B-Instruct2026.04 | 1.88 | 1.52 | |
| MedusaBase Model=Codellama-7B-Instruct2026.04 | 1.78 | 1.96 | |
| MedusaBase Model=Vicuna-7B2026.04 | 1.77 | 1.96 | |
| MedusaBase Model=Vicuna-13B2026.04 | 1.76 | 2.06 | |
| MedusaBase Model=Codellama-13B-Instruct2026.04 | 1.74 | 2.04 | |
| RESTBase Model=Codellama-13B-Instruct2026.04 | 1.63 | 1.23 | |
| RESTBase Model=Vicuna-13B2026.04 | 1.59 | 1.21 | |
| RESTBase Model=Vicuna-7B2026.04 | 1.49 | 1.19 | |
| RESTBase Model=Codellama-7B-Instruct2026.04 | 1.45 | 1.17 |