Mathematical Reasoning on GSM8K (MAT, Speedup)
4.44MAT Score (GSM8K)LogitSpec
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LogitSpecModels=Llama 2 7B2025.07 | 4.44 | 3.68 | |
| LogitSpecModels=Llama 2 13B2025.07 | 4.31 | 3.24 | |
| PLDModels=Llama 2 7B2025.07 | 3.32 | 2.98 | |
| PLDModels=Llama 2 13B2025.07 | 3.24 | 2.54 | |
| SpSModels=Llama 2 13B2025.07 | 2.87 | 1.85 | |
| SpSModels=Llama 2 7B2025.07 | 2.83 | 1.87 | |
| LogitSpecModels=Llama 2 70B2025.07 | 2.37 | 1.87 | |
| LookaheadModels=Llama 2 13B2025.07 | 2.08 | 1.52 | |
| LookaheadModels=Llama 2 7B2025.07 | 2.02 | 1.67 | |
| SpSModels=Llama 2 70B2025.07 | 1.98 | 1.69 | |
| LookaheadModels=Llama 2 70B2025.07 | 1.9 | 1.57 | |
| RESTModels=Llama 2 70B2025.07 | 1.63 | 1.32 | |
| PLDModels=Llama 2 70B2025.07 | 1.63 | 1.46 | |
| RESTModels=Llama 2 13B2025.07 | 1.53 | 1.26 | |
| RESTModels=Llama 2 7B2025.07 | 1.51 | 1.18 |