Input-guided generation on Spec-Bench
2.05MT ScoreTR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TRModel=Vicuna-7B2026.06 | 2.05 | 1.81 | 1.61 | 109.11 | 1.83 | |
| LogitspecModel=Vicuna-7B2026.06 | 1.88 | 2.59 | 1.7 | 123.17 | 2.07 | |
| AdaPLDModel=Vicuna-7B2026.06 | 1.83 | 3.02 | 1.93 | 135.08 | 2.27 | |
| SAMDModel=Vicuna-7B2026.06 | 1.7 | 2.64 | 1.7 | 120.39 | 2.02 | |
| AdaPLDModel=Vicuna-13B2026.06 | 1.7 | 2.45 | 1.79 | 94.88 | 1.98 | |
| LogitspecModel=Vicuna-13B2026.06 | 1.65 | 2.03 | 1.6 | 84.4 | 1.76 | |
| PLD+Model=Vicuna-7B2026.06 | 1.63 | 2.77 | 1.71 | 121.72 | 2.04 | |
| AdaPLDModel=Vicuna-33B2026.06 | 1.62 | 2.1 | 1.5 | 47.7 | 1.74 | |
| SAMDModel=Vicuna-13B2026.06 | 1.6 | 2.17 | 1.62 | 86.3 | 1.8 | |
| SAMDModel=Vicuna-33B2026.06 | 1.53 | 1.91 | 1.41 | 44.34 | 1.62 | |
| PLD+Model=Vicuna-13B2026.06 | 1.5 | 2.22 | 1.6 | 85.09 | 1.78 | |
| TRModel=Vicuna-13B2026.06 | 1.48 | 1.32 | 1.26 | 65.06 | 1.36 | |
| PLD+Model=Vicuna-33B2026.06 | 1.48 | 1.95 | 1.38 | 43.98 | 1.6 | |
| PLDModel=Vicuna-7B2026.06 | 1.39 | 2.18 | 1.53 | 101.33 | 1.7 | |
| PLDModel=Vicuna-13B2026.06 | 1.34 | 1.9 | 1.46 | 75.09 | 1.57 | |
| LogitspecModel=Vicuna-33B2026.06 | 1.3 | 1.65 | 1.22 | 38.1 | 1.39 | |
| PLDModel=Vicuna-33B2026.06 | 1.28 | 1.66 | 1.19 | 37.85 | 1.38 | |
| TRModel=Vicuna-33B2026.06 | 1.25 | 1.22 | 1.15 | 33.18 | 1.21 | |
| ARModel=Vicuna-7B2026.06 | 1 | 1 | 1 | 59.55 | 1 | |
| ARModel=Vicuna-13B2026.06 | 1 | 1 | 1 | 47.87 | 1 | |
| ARModel=Vicuna-33B2026.06 | 1 | 1 | 1 | 27.43 | 1 |