Question Answering on NewsQA (Latency, HBM, F1)
112.36Latency (s)MEPIC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MEPICModel=Mistral-7B-Instruct-v0.32025.12 | 112.36 | 36.43 | 65 | |
| EPICModel=Mistral-7B-Instruct-v0.32025.12 | 115.39 | 45.43 | 66 | |
| CacheBlendModel=Mistral-7B-Instruct-v0.32025.12 | 117 | 45.97 | 66 |