Conversation on Conv.
212.08Throughput (token/s)EAGLE-2(+FR 32k)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EAGLE-2(+FR 32k)Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation, Feature=FR 32k2025.02 | 212.08 | 2.36 | |
| EAGLE-2Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.02 | 187.95 | 2.09 | |
| VanillaBackbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.02 | 89.85 | 1 |