Speculative Sampling on MATH 500
5.67Average Acceptance LengthHASS
Evaluation results
| Method | Links | |
|---|---|---|
| HASSModel Variant=Mixed 70k+70k, Temperature=02026.03 | 5.67 | |
| HASSModel Variant=Merged Trees, Temperature=02026.03 | 5.65 | |
| EAGLE-2Model Variant=Merged Trees, Temperature=02026.03 | 5.63 | |
| HASSModel Variant=Confidence Routed, Temperature=02026.03 | 5.37 | |
| HASSModel Variant=MathInstruct, Temperature=02026.03 | 5.35 | |
| EAGLE-2Model Variant=MathInstruct, Temperature=02026.03 | 5.28 | |
| EAGLE-2Model Variant=Confidence Routed, Temperature=02026.03 | 5.25 | |
| HASSModel Variant=Mixed 35k+35k, Temperature=02026.03 | 5.02 | |
| HASSModel Variant=Merged Trees, Temperature=12026.03 | 4.98 | |
| EAGLE-2Model Variant=Mixed 70k+70k, Temperature=02026.03 | 4.85 | |
| EAGLE-2Model Variant=Merged Trees, Temperature=12026.03 | 4.79 | |
| HASSModel Variant=MathInstruct, Temperature=12026.03 | 4.63 | |
| EAGLE-2Model Variant=Confidence Routed, Temperature=12026.03 | 4.62 | |
| EAGLE-2Model Variant=MathInstruct, Temperature=12026.03 | 4.61 | |
| HASSModel Variant=Confidence Routed, Temperature=12026.03 | 4.55 | |
| HASSModel Variant=Mixed 35k+35k, Temperature=12026.03 | 4.47 | |
| EAGLE-2Model Variant=Mixed 35k+35k, Temperature=02026.03 | 4.44 | |
| EAGLE-2Model Variant=Mixed 35k+35k, Temperature=12026.03 | 4.02 | |
| HASSModel Variant=ShareGPT, Temperature=02026.03 | 3.98 | |
| EAGLE-2Model Variant=ShareGPT, Temperature=02026.03 | 3.81 | |
| HASSModel Variant=ShareGPT, Temperature=12026.03 | 3.61 | |
| EAGLE-2Model Variant=ShareGPT, Temperature=12026.03 | 3.43 | |
| HASSModel Variant=Mixed 70k+70k, Temperature=12026.03 | 3.42 | |
| EAGLE-2Model Variant=Mixed 70k+70k, Temperature=12026.03 | 3.2 | |
| HASSModel Variant=Averaged, Temperature=02026.03 | 3.12 | |
| HASSModel Variant=Averaged, Temperature=12026.03 | 2.9 | |
| EAGLE-2Model Variant=Averaged, Temperature=02026.03 | 2.57 | |
| EAGLE-2Model Variant=Averaged, Temperature=12026.03 | 2.42 |