Retrieval-Augmented Generation on Spec-Bench RAG
5.48CRSpecBound
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SpecBoundBase Model=Vicuna-7B2026.04 | 5.48 | 2.31 | |
| SpecBoundBase Model=Vicuna-13B2026.04 | 5.25 | 2.26 | |
| SpecBoundBase Model=Codellama-7B-Instruct2026.04 | 3.98 | 1.88 | |
| SpecBoundBase Model=Codellama-13B-Instruct2026.04 | 3.82 | 3.25 | |
| AdaDecodeBase Model=Codellama-13B-Instruct2026.04 | 2.7 | 1.58 | |
| AdaDecodeBase Model=Codellama-7B-Instruct2026.04 | 2.5 | 1.48 | |
| KangarooBase Model=Vicuna-13B2026.04 | 2.16 | 1.4 | |
| KangarooBase Model=Vicuna-7B2026.04 | 2.05 | 1.52 | |
| RESTBase Model=Codellama-7B-Instruct2026.04 | 1.99 | 1.77 | |
| RESTBase Model=Vicuna-7B2026.04 | 1.96 | 1.75 | |
| SPACEBase Model=Vicuna-7B2026.04 | 1.88 | 1.24 | |
| RESTBase Model=Vicuna-13B2026.04 | 1.83 | 1.53 | |
| RESTBase Model=Codellama-13B-Instruct2026.04 | 1.8 | 1.51 | |
| MedusaBase Model=Codellama-13B-Instruct2026.04 | 1.6 | 1.65 | |
| LookaheadBase Model=Codellama-7B-Instruct2026.04 | 1.57 | 1.26 | |
| LookaheadBase Model=Vicuna-7B2026.04 | 1.53 | 1.24 | |
| MedusaBase Model=Vicuna-13B2026.04 | 1.49 | 1.59 | |
| LookaheadBase Model=Vicuna-13B2026.04 | 1.48 | 1.19 | |
| MedusaBase Model=Vicuna-7B2026.04 | 1.47 | 1.47 | |
| LookaheadBase Model=Codellama-13B-Instruct2026.04 | 1.45 | 1.17 | |
| MedusaBase Model=Codellama-7B-Instruct2026.04 | 1.44 | 1.45 |