Mathematics on MATH (MAT, Speedup)
3.05MAT ScoreLogitSpec
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LogitSpecBackbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 3.05 | 2.56 | |
| Token RecyclingBackbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 2.8 | 2.4 | |
| SAM DecodingBackbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 2.66 | 2.26 | |
| AR (Greedy)Backbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 1 | 1 |