Instruction Following on Alpaca (acceptance length)
3.59Acceptance LengthLlama 3.1 8B + EAGLE3
Evaluation results
| Method | Links | |
|---|---|---|
| Llama 3.1 8B + EAGLE3Model=Llama 3.1 8B, Decoding Method=SGLang + EAGLE3, Steps=7, Top-k=1, Draft Length=8, Normalization=Post-norm2026.05 | 3.59 | |
| Llama 3.1 8B + EAGLE3Model=Llama 3.1 8B, Decoding Method=SGLang + EAGLE3, Steps=7, Top-k=1, Draft Length=8, Normalization=Pre-norm2026.05 | 3.52 | |
| Qwen3 8B + EAGLE3Drafter Norm=Post, Decoding Mode=no-thinking2026.05 | 3.35 | |
| Qwen3 8B + EAGLE3Drafter Norm=Pre, Decoding Mode=no-thinking2026.05 | 3.14 | |
| Qwen3 8B + EAGLE3Drafter Norm=Post, Decoding Mode=thinking2026.05 | 2.82 | |
| Qwen3 8B + EAGLE3Drafter Norm=Pre, Decoding Mode=thinking2026.05 | 2.68 |