Speculative Sampling on SVAMP
5.38Average Acceptance LengthHASS
Evaluation results
| Method | Links | |
|---|---|---|
| HASSModel Variant=Mixed 70k+70k, Temperature=02026.03 | 5.38 | |
| HASSModel Variant=Merged Trees, Temperature=02026.03 | 5.31 | |
| EAGLE-2Model Variant=Merged Trees, Temperature=02026.03 | 5.25 | |
| HASSModel Variant=Merged Trees, Temperature=12026.03 | 5.05 | |
| EAGLE-2Model Variant=Merged Trees, Temperature=12026.03 | 4.93 | |
| HASSModel Variant=Confidence Routed, Temperature=02026.03 | 4.89 | |
| EAGLE-2Model Variant=MathInstruct, Temperature=02026.03 | 4.81 | |
| EAGLE-2Model Variant=Confidence Routed, Temperature=02026.03 | 4.71 | |
| HASSModel Variant=Confidence Routed, Temperature=12026.03 | 4.71 | |
| EAGLE-2Model Variant=Mixed 70k+70k, Temperature=02026.03 | 4.64 | |
| HASSModel Variant=Mixed 35k+35k, Temperature=12026.03 | 4.57 | |
| EAGLE-2Model Variant=MathInstruct, Temperature=12026.03 | 4.53 | |
| EAGLE-2Model Variant=Confidence Routed, Temperature=12026.03 | 4.46 | |
| HASSModel Variant=ShareGPT, Temperature=02026.03 | 4.44 | |
| EAGLE-2Model Variant=Mixed 35k+35k, Temperature=02026.03 | 4.16 | |
| HASSModel Variant=Mixed 35k+35k, Temperature=02026.03 | 4.15 | |
| EAGLE-2Model Variant=Mixed 35k+35k, Temperature=12026.03 | 4.03 | |
| HASSModel Variant=Mixed 70k+70k, Temperature=12026.03 | 4.01 | |
| HASSModel Variant=ShareGPT, Temperature=12026.03 | 3.95 | |
| EAGLE-2Model Variant=ShareGPT, Temperature=02026.03 | 3.71 | |
| EAGLE-2Model Variant=ShareGPT, Temperature=12026.03 | 3.65 | |
| HASSModel Variant=MathInstruct, Temperature=02026.03 | 3.13 | |
| EAGLE-2Model Variant=Mixed 70k+70k, Temperature=12026.03 | 3.08 | |
| HASSModel Variant=Averaged, Temperature=12026.03 | 2.69 | |
| EAGLE-2Model Variant=Averaged, Temperature=02026.03 | 2.5 | |
| HASSModel Variant=MathInstruct, Temperature=12026.03 | 2.46 | |
| EAGLE-2Model Variant=Averaged, Temperature=12026.03 | 2.45 | |
| HASSModel Variant=Averaged, Temperature=02026.03 | 2.13 |