Reasoning on AIME 2024 (Normalized Speedup)
3.15Normalized SpeedupLogitspec
Evaluation Results
| Method | Links | |
|---|---|---|
| LogitspecBackbone=Vicuna-7B2026.06 | 3.15 | |
| AdaPLDBackbone=Vicuna-7B2026.06 | 2.98 | |
| SAMDBackbone=Vicuna-7B2026.06 | 2.78 | |
| PLD+Backbone=Vicuna-7B2026.06 | 2.61 | |
| AdaPLDBackbone=Vicuna-13B2026.06 | 2.56 | |
| PLD+Backbone=Vicuna-13B2026.06 | 2.36 | |
| SAMDBackbone=Vicuna-13B2026.06 | 2.34 | |
| LogitspecBackbone=Vicuna-13B2026.06 | 2.33 | |
| TRBackbone=Vicuna-7B2026.06 | 2.22 | |
| AdaPLDBackbone=Vicuna-33B2026.06 | 2.1 | |
| PLDBackbone=Vicuna-7B2026.06 | 2.01 | |
| PLD+Backbone=Vicuna-33B2026.06 | 1.86 | |
| SAMDBackbone=Vicuna-33B2026.06 | 1.84 | |
| PLDBackbone=Vicuna-13B2026.06 | 1.73 | |
| TRBackbone=Vicuna-13B2026.06 | 1.64 | |
| LogitspecBackbone=Vicuna-33B2026.06 | 1.6 | |
| PLDBackbone=Vicuna-33B2026.06 | 1.5 | |
| TRBackbone=Vicuna-33B2026.06 | 1.37 | |
| ARBackbone=Vicuna-7B2026.06 | 1 | |
| ARBackbone=Vicuna-13B2026.06 | 1 | |
| ARBackbone=Vicuna-33B2026.06 | 1 |