Reasoning on MMLU-Pro (Normalized Speedup)
2.44Normalized SpeedupAdaPLD
Evaluation Results
| Method | Links | |
|---|---|---|
| AdaPLDBackbone=Vicuna-7B2026.06 | 2.44 | |
| TRBackbone=Vicuna-7B2026.06 | 2.18 | |
| SAMDBackbone=Vicuna-7B2026.06 | 2.14 | |
| PLD+Backbone=Vicuna-7B2026.06 | 2.12 | |
| AdaPLDBackbone=Vicuna-13B2026.06 | 2.08 | |
| LogitspecBackbone=Vicuna-7B2026.06 | 1.94 | |
| PLD+Backbone=Vicuna-13B2026.06 | 1.81 | |
| AdaPLDBackbone=Vicuna-33B2026.06 | 1.81 | |
| SAMDBackbone=Vicuna-13B2026.06 | 1.79 | |
| PLDBackbone=Vicuna-7B2026.06 | 1.68 | |
| SAMDBackbone=Vicuna-33B2026.06 | 1.67 | |
| PLD+Backbone=Vicuna-33B2026.06 | 1.64 | |
| TRBackbone=Vicuna-13B2026.06 | 1.59 | |
| LogitspecBackbone=Vicuna-13B2026.06 | 1.54 | |
| PLDBackbone=Vicuna-13B2026.06 | 1.47 | |
| LogitspecBackbone=Vicuna-33B2026.06 | 1.46 | |
| PLDBackbone=Vicuna-33B2026.06 | 1.42 | |
| TRBackbone=Vicuna-33B2026.06 | 1.29 | |
| ARBackbone=Vicuna-7B2026.06 | 1 | |
| ARBackbone=Vicuna-13B2026.06 | 1 | |
| ARBackbone=Vicuna-33B2026.06 | 1 |