Retrieval Augmented Generation on RAG
178.64Tokens per SecondEAGLE-2(+FR 32k)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EAGLE-2(+FR 32k)Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation, Feature=FR 32k2025.02 | 178.64 | 2.15 | |
| EAGLE-2Backbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.02 | 159.37 | 1.92 | |
| VanillaBackbone=Llama-3-8B, Temperature=1, Implementation=Our Implementation2025.02 | 83.18 | 1 |