Long-context Understanding on LongBench (MAT and Speedup)
3.08MATLogitSpec
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LogitSpecBackbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 3.08 | 2.1 | |
| SAM DecodingBackbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 3.01 | 2.04 | |
| Token RecyclingBackbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 2.96 | 1.97 | |
| AR (Greedy)Backbone=Llama-3.1-8B-Instruct, Temperature (T)=0, Tree capacity (K)=642025.07 | 1 | 1 |