Summarization on Summarization (Inference Speed)
182.7Throughput (tokens/s)EAGLE-2(+FR 32k)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EAGLE-2(+FR 32k)Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation, Feature=FR 32k2025.02 | 182.7 | 2.09 | |
| EAGLE-2Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.02 | 158.72 | 1.82 | |
| VanillaBackbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.02 | 87.41 | 1 |