Long-context language generation on Multi-News
3.51Average Acceptance Length (τ)LongSpec
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LongSpecBackbone=V-7B, Temperature=02025.02 | 3.51 | 100.55 | 1.8 | |
| LongSpecBackbone=LC-13B, Temperature=02025.02 | 3.5 | 80.48 | 2.28 | |
| LongSpecBackbone=V-13B, Temperature=02025.02 | 3.44 | 78.2 | 2.23 | |
| LongSpecBackbone=LC-7B, Temperature=02025.02 | 3.41 | 97.93 | 1.95 | |
| LongSpecBackbone=L-8B, Temperature=02025.02 | 3.36 | 91.11 | 1.6 | |
| MagicDecBackbone=V-13B, Temperature=02025.02 | 2.97 | 39.47 | 1.13 | |
| MagicDecBackbone=LC-13B, Temperature=02025.02 | 2.43 | 32.58 | 0.92 | |
| MagicDecBackbone=L-8B, Temperature=02025.02 | 2.33 | 39.57 | 0.7 | |
| MagicDecBackbone=LC-7B, Temperature=02025.02 | 2.32 | 43.94 | 0.88 | |
| MagicDecBackbone=V-7B, Temperature=02025.02 | 2.31 | 44.82 | 0.8 | |
| PLDBackbone=V-7B, Temperature=02025.02 | 2.15 | 72.31 | 1.29 | |
| PLDBackbone=LC-7B, Temperature=02025.02 | 2 | 67.66 | 1.35 | |
| PLDBackbone=L-8B, Temperature=02025.02 | 1.94 | 78 | 1.37 | |
| PLDBackbone=LC-13B, Temperature=02025.02 | 1.85 | 43.74 | 1.24 | |
| PLDBackbone=V-13B, Temperature=02025.02 | 1.35 | 34.97 | 1 | |
| Vanilla HFBackbone=V-7B, Temperature=02025.02 | 1 | 27.29 | — | |
| Vanilla FABackbone=V-7B, Temperature=02025.02 | 1 | 55.99 | 1 | |
| Vanilla HFBackbone=V-13B, Temperature=02025.02 | 1 | 18.81 | — | |
| Vanilla FABackbone=V-13B, Temperature=02025.02 | 1 | 35.01 | 1 | |
| Vanilla HFBackbone=LC-7B, Temperature=02025.02 | 1 | 27.66 | — | |
| Vanilla FABackbone=LC-7B, Temperature=02025.02 | 1 | 50.19 | 1 | |
| Vanilla HFBackbone=LC-13B, Temperature=02025.02 | 1 | 18.74 | — | |
| Vanilla FABackbone=LC-13B, Temperature=02025.02 | 1 | 35.37 | 1 | |
| Vanilla HFBackbone=L-8B, Temperature=02025.02 | 1 | 29.91 | — | |
| Vanilla FABackbone=L-8B, Temperature=02025.02 | 1 | 56.94 | 1 |