Information Retrieval on FIQA
54MRRQUARK
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| QUARKRetriever=Dense-2, alpha=0.72026.01 | 54 | 45.4 | 65.3 | 74.7 | 45.9 | — | — | |
| Dense-2Retriever=Dense-22026.01 | 53.2 | 44.6 | 64.4 | 73.2 | 45 | — | — | |
| QUARKRetriever=BM25, alpha=0.62026.01 | 29 | 22.1 | 39.2 | 47.1 | 23.5 | — | — | |
| BM25Retriever=BM252026.01 | 27.1 | 20.4 | 36.4 | 44.9 | 21.8 | — | — | |
| QUARKRetriever=Dense-1, alpha=0.952026.01 | 26.7 | 19.8 | 36.3 | 43.2 | 20.9 | — | — | |
| Dense-1Retriever=Dense-12026.01 | 26.2 | 20.1 | 34.7 | 42 | 20.3 | — | — | |
| IMRNNsBackbone=Hyp(8)2026.01 | 0.42 | — | — | — | — | 0.36 | 0.44 | |
| Hyprank=22026.01 | 0.39 | — | — | — | — | 0.32 | 0.4 | |
| Hyprank=82026.01 | 0.39 | — | — | — | — | 0.33 | 0.42 | |
| Hyprank=62026.01 | 0.37 | — | — | — | — | 0.32 | 0.42 | |
| IMRNNsBackbone=BGE2026.01 | 0.37 | — | — | — | — | 0.25 | 0.29 | |
| Hyprank=42026.01 | 0.35 | — | — | — | — | 0.31 | 0.42 | |
| BGE2026.01 | 0.34 | — | — | — | — | 0.23 | 0.27 | |
| IMRNNsBackbone=MiniLM2026.01 | 0.33 | — | — | — | — | 0.23 | 0.27 | |
| MiniLM2026.01 | 0.32 | — | — | — | — | 0.22 | 0.26 | |
| IMRNNsBackbone=e5-large-v22026.01 | 0.29 | — | — | — | — | 0.22 | 0.24 | |
| e5-large-v22026.01 | 0.28 | — | — | — | — | 0.2 | 0.23 | |
| DIMESelection Ratio=20%2026.01 | 0.28 | — | — | — | — | 0.2 | 0.22 | |
| DIMESelection Ratio=40%2026.01 | 0.27 | — | — | — | — | 0.19 | 0.21 | |
| DIMESelection Ratio=60%2026.01 | 0.25 | — | — | — | — | 0.18 | 0.2 | |
| SearchAd2026.01 | 0.25 | — | — | — | — | 0.17 | 0.2 | |
| DIMESelection Ratio=80%2026.01 | 0.23 | — | — | — | — | 0.14 | 0.16 | |
| Baseretriever=Sparse BM252025.10 | — | — | — | — | 0.236 | — | — | |
| Baseretriever=Dense, backbone=Contriever-msmarco2025.10 | — | — | — | — | 0.329 | — | — | |
| DRretriever=Sparse BM25, model_scale=3B2025.10 | — | — | — | — | 0.256 | — | — | |
| DRretriever=Sparse BM25, model_scale=7B2025.10 | — | — | — | — | 0.247 | — | — | |
| DRretriever=Dense, backbone=Contriever-msmarco, model_scale=3B2025.10 | — | — | — | — | 0.331 | — | — | |
| DRretriever=Dense, backbone=Contriever-msmarco, model_scale=7B2025.10 | — | — | — | — | 0.34 | — | — | |
| OPQEretriever=Sparse BM25, model_scale=3B2025.10 | — | — | — | — | 0.25 | — | — | |
| OPQEretriever=Sparse BM25, model_scale=7B2025.10 | — | — | — | — | 0.249 | — | — | |
| OPQEretriever=Dense, backbone=Contriever-msmarco, model_scale=3B2025.10 | — | — | — | — | 0.341 | — | — | |
| OPQEretriever=Dense, backbone=Contriever-msmarco, model_scale=7B2025.10 | — | — | — | — | 0.344 | — | — | |
| SPQEretriever=Sparse BM252025.10 | — | — | — | — | 0.195 | — | — | |
| SPQEretriever=Dense, backbone=Contriever-msmarco2025.10 | — | — | — | — | 0.265 | — | — |