Speculative Decoding on MT-bench (Llama3.1-8B-Instruct v1 test)
3.19MT ScoreUniVer
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| UniVerMethod Paradigm=OT-based, Tree Structure=balanced binary tree, Tree Depth=5, Number of Leaf Nodes=32, Temperature=1.0, Backbone=Llama3.1-8B-Instruct2026.05 | 3.19 | 2.57 | 2.77 | 2.57 | 3.51 | 3.11 | 2.95 | 52.2 | |
| GreedyMethod Paradigm=OT-based, Tree Structure=balanced binary tree, Tree Depth=5, Number of Leaf Nodes=32, Temperature=1.0, Backbone=Llama3.1-8B-Instruct2026.05 | 3.09 | 2.54 | 2.7 | 2.46 | 3.45 | 3.04 | 2.88 | 50.6 | |
| TraversalMethod Paradigm=RRSw-based, Tree Structure=balanced binary tree, Tree Depth=5, Number of Leaf Nodes=32, Temperature=1.0, Backbone=Llama3.1-8B-Instruct2026.05 | 3.05 | 2.34 | 2.6 | 2.4 | 3.37 | 2.94 | 2.78 | 49.5 | |
| RRSwMethod Paradigm=RRSw-based, Tree Structure=balanced binary tree, Tree Depth=5, Number of Leaf Nodes=32, Temperature=1.0, Backbone=Llama3.1-8B-Instruct2026.05 | 2.96 | 2.31 | 2.56 | 2.33 | 3.31 | 2.86 | 2.72 | 48.5 |