Text Generation on CNN/DailyMail
3.56SpeedupHybrid Verified Decoding
Evaluation Results
| Method | Links | |
|---|---|---|
| Hybrid Verified DecodingTarget Model=Qwen3-8B, Serving Stack=vLLM, Baseline Comparison=vs. EAGLE32026.05 | 3.56 | |
| Hybrid Verified DecodingTarget Model=Qwen3-8B, Serving Stack=vLLM, Baseline Comparison=vs. SuffixDecoding2026.05 | 1.16 |