Speculative Decoding on SpecBench Vicuna-33B v1.3 (test)
3.52MT ScoreUniVer
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| UniVerMethod Category=OT-based, Base Model=Vicuna-33B-v1.32026.05 | 3.52 | 2.83 | 3.11 | 2.81 | 3.86 | 3.1 | 3.21 | 21.4 | |
| GreedyMethod Category=OT-based, Base Model=Vicuna-33B-v1.32026.05 | 3.5 | 2.8 | 3.07 | 2.78 | 3.82 | 3.05 | 3.17 | 21.2 | |
| TraversalMethod Category=RRSw-based, Base Model=Vicuna-33B-v1.32026.05 | 3.41 | 2.72 | 3.01 | 2.68 | 3.73 | 2.98 | 3.09 | 20.8 | |
| RRSwMethod Category=RRSw-based, Base Model=Vicuna-33B-v1.32026.05 | 3.38 | 2.68 | 2.97 | 2.66 | 3.7 | 2.94 | 3.05 | 20.6 |