Code Generation on HumanEval (MAT and Token/s)
1MATVicuna-7B-v1.5
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Vicuna-7B-v1.5Framework=Vanilla2025.10 | 1 | 33.59 | |
| Exp3SpecFramework=REST, Target Model=Vicuna-7B-v1.52025.10 | 1.43 | 43.55 | |
| UCBSpecFramework=REST, Target Model=Vicuna-7B-v1.52025.10 | 1.45 | 44.6 | |
| HedgeSpecFramework=REST, Target Model=Vicuna-7B-v1.52025.10 | 1.88 | 55.27 |