Speculative Sampling Evaluation on MT-Bench
4.13Average Acceptance LengthHASS
Evaluation results
| Method | Links | |
|---|---|---|
| HASSModel Variant=Mixed 70k+70k, Temperature=02026.03 | 4.13 | |
| HASSModel Variant=Merged Trees, Temperature=02026.03 | 4.05 | |
| HASSModel Variant=ShareGPT, Temperature=02026.03 | 3.98 | |
| HASSModel Variant=Confidence Routed, Temperature=02026.03 | 3.93 | |
| EAGLE-2Model Variant=Merged Trees, Temperature=02026.03 | 3.93 | |
| HASSModel Variant=Mixed 35k+35k, Temperature=02026.03 | 3.92 | |
| HASSModel Variant=Merged Trees, Temperature=12026.03 | 3.76 | |
| EAGLE-2Model Variant=Mixed 70k+70k, Temperature=02026.03 | 3.75 | |
| EAGLE-2Model Variant=Confidence Routed, Temperature=02026.03 | 3.63 | |
| EAGLE-2Model Variant=ShareGPT, Temperature=02026.03 | 3.57 | |
| EAGLE-2Model Variant=Merged Trees, Temperature=12026.03 | 3.55 | |
| HASSModel Variant=Confidence Routed, Temperature=12026.03 | 3.51 | |
| HASSModel Variant=ShareGPT, Temperature=12026.03 | 3.5 | |
| HASSModel Variant=Mixed 35k+35k, Temperature=12026.03 | 3.46 | |
| EAGLE-2Model Variant=ShareGPT, Temperature=12026.03 | 3.38 | |
| EAGLE-2Model Variant=Mixed 35k+35k, Temperature=02026.03 | 3.37 | |
| EAGLE-2Model Variant=Confidence Routed, Temperature=12026.03 | 3.36 | |
| HASSModel Variant=Mixed 70k+70k, Temperature=12026.03 | 3.17 | |
| EAGLE-2Model Variant=Mixed 35k+35k, Temperature=12026.03 | 3.1 | |
| EAGLE-2Model Variant=Mixed 70k+70k, Temperature=12026.03 | 2.99 | |
| HASSModel Variant=MathInstruct, Temperature=02026.03 | 2.9 | |
| EAGLE-2Model Variant=MathInstruct, Temperature=02026.03 | 2.54 | |
| EAGLE-2Model Variant=MathInstruct, Temperature=12026.03 | 2.43 | |
| HASSModel Variant=MathInstruct, Temperature=12026.03 | 2.31 | |
| HASSModel Variant=Averaged, Temperature=02026.03 | 2.29 | |
| HASSModel Variant=Averaged, Temperature=12026.03 | 2.1 | |
| EAGLE-2Model Variant=Averaged, Temperature=02026.03 | 2.07 | |
| EAGLE-2Model Variant=Averaged, Temperature=12026.03 | 2.01 |