Long-context language generation on LCC
4.21Average Acceptance Length (τ)LongSpec
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LongSpecBackbone=LC-7B, Temperature=02025.02 | 4.21 | 122.3 | 2.26 | |
| LongSpecBackbone=LC-13B, Temperature=02025.02 | 4.01 | 90.92 | 2.63 | |
| LongSpecBackbone=V-7B, Temperature=02025.02 | 3.73 | 107.3 | 1.99 | |
| LongSpecBackbone=V-13B, Temperature=02025.02 | 3.57 | 81 | 2.39 | |
| LongSpecBackbone=L-8B, Temperature=02025.02 | 3.28 | 89.33 | 1.57 | |
| MagicDecBackbone=V-13B, Temperature=02025.02 | 2.96 | 38.4 | 1.13 | |
| MagicDecBackbone=LC-7B, Temperature=02025.02 | 2.77 | 51.73 | 0.96 | |
| MagicDecBackbone=LC-13B, Temperature=02025.02 | 2.68 | 35.77 | 1.03 | |
| MagicDecBackbone=L-8B, Temperature=02025.02 | 2.65 | 46.95 | 0.83 | |
| MagicDecBackbone=V-7B, Temperature=02025.02 | 2.52 | 46.96 | 0.87 | |
| PLDBackbone=LC-7B, Temperature=02025.02 | 2.48 | 85.62 | 1.58 | |
| PLDBackbone=V-7B, Temperature=02025.02 | 2.43 | 78.41 | 1.45 | |
| PLDBackbone=LC-13B, Temperature=02025.02 | 1.88 | 49.12 | 1.42 | |
| PLDBackbone=L-8B, Temperature=02025.02 | 1.59 | 54.75 | 0.97 | |
| PLDBackbone=V-13B, Temperature=02025.02 | 1.34 | 36.24 | 1.07 | |
| Vanilla HFBackbone=V-7B, Temperature=02025.02 | 1 | 25.25 | — | |
| Vanilla FABackbone=V-7B, Temperature=02025.02 | 1 | 54.07 | 1 | |
| Vanilla HFBackbone=V-13B, Temperature=02025.02 | 1 | 17.25 | — | |
| Vanilla FABackbone=V-13B, Temperature=02025.02 | 1 | 33.87 | 1 | |
| Vanilla HFBackbone=LC-7B, Temperature=02025.02 | 1 | 25.27 | — | |
| Vanilla FABackbone=LC-7B, Temperature=02025.02 | 1 | 54.17 | 1 | |
| Vanilla HFBackbone=LC-13B, Temperature=02025.02 | 1 | 17.72 | — | |
| Vanilla FABackbone=LC-13B, Temperature=02025.02 | 1 | 34.58 | 1 | |
| Vanilla HFBackbone=L-8B, Temperature=02025.02 | 1 | 29.48 | — | |
| Vanilla FABackbone=L-8B, Temperature=02025.02 | 1 | 56.73 | 1 |