Information Retrieval on NQ (test) using Recall@K
75.5Recall@5MEVI
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MEVIIndex size (GB)=151.0, Query time (ms)=222.5, Search strategy=HNSW, Top-k selection=Top-1002025.05 | 75.5 | 82.8 | 87.3 | |
| HbRIndex size (GB)=4.6, Query time (ms)=42.32025.05 | 72.4 | 80.3 | 87.5 | |
| DPRIndex size (GB)=64.6, Query time (ms)=456.92025.05 | 66 | 78.4 | 85.4 | |
| DSHIndex size (GB)=2.2, Query time (ms)=38.1, Backbone=DPR, Candidate size=10002025.05 | 57.2 | 77.9 | 85.7 | |
| PQIndex size (GB)=2.0, Query time (ms)=46.22025.05 | 50.7 | 72.2 | 81.2 | |
| ContrieverIndex size (GB)=64.6, Query time (ms)=608.02025.05 | 47.8 | 67.8 | 82.1 | |
| BM25Index size (GB)=7.4, Query time (ms)=913.82025.05 | 45.2 | 59.1 | 73.7 | |
| LSHIndex size (GB)=2.0, Query time (ms)=28.8, Backbone=DPR2025.05 | 43.2 | 63.9 | 77.2 | |
| SimCSEIndex size (GB)=64.6, Query time (ms)=548.22025.05 | 28.8 | 44.3 | 47 |