Question Answering on NarrativeQA (Latency, HBM, ROUGE-L)
97.71Latency (s)MEPIC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MEPICModel=Mistral-7B-Instruct-v0.32025.12 | 97.71 | 29.67 | 0.6 | |
| EPICModel=Mistral-7B-Instruct-v0.32025.12 | 100.06 | 50.4 | 0.61 | |
| CacheBlendModel=Mistral-7B-Instruct-v0.32025.12 | 104.72 | 50.4 | 0.61 |