Information Retrieval on TQA (test)
78.3Recall@5HbR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HbRIndex size (GB)=4.6, Query time (ms)=42.32025.05 | 78.3 | 87 | 88.4 | |
| DPRIndex size (GB)=64.6, Query time (ms)=456.92025.05 | 71.6 | 79.4 | 85 | |
| DSHIndex size (GB)=2.2, Query time (ms)=38.1, Backbone=DPR, Candidate size=10002025.05 | 64.7 | 77.9 | 84.5 | |
| PQIndex size (GB)=2.0, Query time (ms)=46.22025.05 | 63 | 73.2 | 80.4 | |
| ContrieverIndex size (GB)=64.6, Query time (ms)=608.02025.05 | 59.4 | 74.2 | 83.2 | |
| BM25Index size (GB)=7.4, Query time (ms)=913.82025.05 | 55.7 | 66.9 | 76.7 | |
| LSHIndex size (GB)=2.0, Query time (ms)=28.8, Backbone=DPR2025.05 | 48 | 65.2 | 76.9 | |
| SimCSEIndex size (GB)=64.6, Query time (ms)=548.22025.05 | 44.9 | 59.4 | 62.4 |