Reasoning on MATH 500 (Normalized speedup)
2.68Normalized SpeedupLogitspec
Evaluation Results
| Method | Links | |
|---|---|---|
| LogitspecBackbone=Vicuna-7B2026.06 | 2.68 | |
| AdaPLDBackbone=Vicuna-7B2026.06 | 2.55 | |
| PLD+Backbone=Vicuna-7B2026.06 | 2.42 | |
| TRBackbone=Vicuna-7B2026.06 | 2.36 | |
| SAMDBackbone=Vicuna-7B2026.06 | 2.32 | |
| AdaPLDBackbone=Vicuna-13B2026.06 | 2.26 | |
| LogitspecBackbone=Vicuna-13B2026.06 | 2.12 | |
| AdaPLDBackbone=Vicuna-33B2026.06 | 2.02 | |
| PLD+Backbone=Vicuna-13B2026.06 | 1.98 | |
| SAMDBackbone=Vicuna-13B2026.06 | 1.95 | |
| PLD+Backbone=Vicuna-33B2026.06 | 1.83 | |
| SAMDBackbone=Vicuna-33B2026.06 | 1.75 | |
| PLDBackbone=Vicuna-7B2026.06 | 1.74 | |
| TRBackbone=Vicuna-13B2026.06 | 1.65 | |
| PLDBackbone=Vicuna-13B2026.06 | 1.64 | |
| LogitspecBackbone=Vicuna-33B2026.06 | 1.64 | |
| PLDBackbone=Vicuna-33B2026.06 | 1.53 | |
| TRBackbone=Vicuna-33B2026.06 | 1.41 | |
| ARBackbone=Vicuna-7B2026.06 | 1 | |
| ARBackbone=Vicuna-13B2026.06 | 1 | |
| ARBackbone=Vicuna-33B2026.06 | 1 |