Speculative Decoding on MT-Bench (Vicuna-7B-v1.3)
3.68MT ScoreUniVer
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| UniVerParadigm=OT-based, Base Model=Vicuna-7B-v1.3, Tree Depth=5, Temperature=1.02026.05 | 3.68 | 2.83 | 3.21 | 2.94 | 3.76 | 3.32 | 3.29 | 7.5 | 72.2 | |
| GreedyParadigm=OT-based, Base Model=Vicuna-7B-v1.3, Tree Depth=5, Temperature=1.02026.05 | 3.56 | 2.8 | 3.12 | 2.87 | 3.66 | 3.24 | 3.21 | 4.9 | 70.4 | |
| TraversalParadigm=RRSw-based, Base Model=Vicuna-7B-v1.3, Tree Depth=5, Temperature=1.02026.05 | 3.49 | 2.75 | 3.03 | 2.79 | 3.55 | 3.15 | 3.13 | 2.3 | 68.9 | |
| RRSwParadigm=RRSw-based, Base Model=Vicuna-7B-v1.3, Tree Depth=5, Temperature=1.02026.05 | 3.42 | 2.73 | 2.97 | 2.72 | 3.47 | 3.05 | 3.06 | 0 | 67.5 |