Efficiency Evaluation on NQ (test)
3.79Inference Time (h)closed-book
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| closed-bookReader LLM=Flan-UL22025.06 | 3.79 | — | 3.79 | 0.26 | |
| RECOMPReader LLM=Flan-UL22025.06 | 4.08 | 0.27 | 4.35 | 0.23 | |
| ECoRAGReader LLM=Flan-UL22025.06 | 4.23 | 0.73 | 4.96 | 0.2 | |
| CompActReader LLM=Flan-UL22025.06 | 4.83 | 10.1 | 14.94 | 0.07 | |
| standard RAGReader LLM=Flan-UL22025.06 | 12.28 | — | 12.28 | 0.08 |