Information Retrieval on HQA (test)
57.7Recall@5HbR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HbRIndex size (GB)=4.6, Query time (ms)=42.32025.05 | 57.7 | 80.2 | 81.4 | |
| DPRIndex size (GB)=64.6, Query time (ms)=456.92025.05 | 54.4 | 73 | 80.3 | |
| DSHIndex size (GB)=2.2, Query time (ms)=38.1, Backbone=DPR, Candidate size=10002025.05 | 44.2 | 66.2 | 80.4 | |
| PQIndex size (GB)=2.0, Query time (ms)=46.22025.05 | 43.7 | 64.3 | 62.1 | |
| ContrieverIndex size (GB)=64.6, Query time (ms)=608.02025.05 | 42.5 | 67.4 | 76.9 | |
| LSHIndex size (GB)=2.0, Query time (ms)=28.8, Backbone=DPR2025.05 | 38.4 | 60.5 | 71.1 | |
| SimCSEIndex size (GB)=64.6, Query time (ms)=548.22025.05 | 26.7 | 44.1 | 46.1 |