Summarization on LongBench Gov Report (test)
1.7Avg Accepted Draft Tokens per RoundLlama 3.1 8B (Post-norm)
Evaluation results
| Method | Links | |
|---|---|---|
| Llama 3.1 8B (Post-norm)SWA mode=SWA + Sys Prompt, Window=10242026.05 | 1.7 | |
| Llama 3.1 8B (Post-norm)SWA mode=SWA + BoS, Window=10242026.05 | 1.57 | |
| Llama 3.1 8B (Pre-norm)SWA mode=SWA + BoS, Window=10242026.05 | 1.35 | |
| Llama 3.1 8B (Pre-norm)SWA mode=SWA + Sys Prompt, Window=10242026.05 | 0.47 |