Coding on LongBench Repobench (test)
2.26Avg Accepted Draft Tokens/RoundLlama 3.1 8B (Post-norm)
Evaluation results
| Method | Links | |
|---|---|---|
| Llama 3.1 8B (Post-norm)SWA mode=SWA + BoS, Window=10242026.05 | 2.26 | |
| Llama 3.1 8B (Post-norm)SWA mode=SWA + Sys Prompt, Window=10242026.05 | 2.25 | |
| Llama 3.1 8B (Pre-norm)SWA mode=SWA + BoS, Window=10242026.05 | 1.85 | |
| Llama 3.1 8B (Pre-norm)SWA mode=SWA + Sys Prompt, Window=10242026.05 | 0.26 |