Information Retrieval on HotpotQA (test)
69.4NDCG@10Ours (Predictive)
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Ours (Predictive)2026.05 | 69.4 | — | — | — | 74.2 | 63.8 | 2.6 | |
| SPLADE++-SelfDistilRetriever Type=Sparse Retriever2024.11 | 68.4 | — | — | — | — | — | — | |
| Sync-RAG2026.05 | 68.2 | — | — | — | 73.1 | 62.4 | 2.8 | |
| Our ModelRetriever Type=Inference-free Sparse Retriever2024.11 | 67.9 | — | — | — | — | — | — | |
| SPLADE-v3-DistilRetriever Type=Sparse Retriever2024.11 | 67.8 | — | — | — | — | — | — | |
| Adaptive-RAG2026.05 | 67.5 | — | — | — | 72.4 | 61.9 | 2.9 | |
| Self-RAG2026.05 | 67.1 | — | — | — | 71.8 | 61.5 | 3.1 | |
| SPLADE-v3-DocRetriever Type=Inference-free Sparse Retriever2024.11 | 66.9 | — | — | — | — | — | — | |
| ColBERTv2Retriever Type=Dense Retriever2024.11 | 66.7 | — | — | — | — | — | — | |
| DRAGIN2026.05 | 66.3 | — | — | — | 70.9 | 60.8 | 3.3 | |
| ContrieverRetriever Type=Dense Retriever2024.11 | 63.8 | — | — | — | — | — | — | |
| SPLADE-doc-distillRetriever Type=Inference-free Sparse Retriever2024.11 | 62.6 | — | — | — | — | — | — | |
| BM25Retriever Type=Inference-free Sparse Retriever2024.11 | 60.2 | — | — | — | — | — | — | |
| TAS-BRetriever Type=Dense Retriever2024.11 | 58.4 | — | — | — | — | — | — | |
| BGEIndexing=Flat2026.04 | — | 94.72 | 99.45 | 1.47 | — | — | — | |
| BGEIndexing=HNSW2026.04 | — | 95.45 | 99.5 | 1.4 | — | — | — | |
| BGEIndexing=IVF-Flat2026.04 | — | 94.8 | 99.45 | 1.46 | — | — | — | |
| BGEIndexing=IVF-PQ2026.04 | — | 95.01 | 99.5 | 1.45 | — | — | — | |
| ContrieverIndexing=Flat2026.04 | — | 93.66 | 99.85 | 1.62 | — | — | — | |
| ContrieverIndexing=HNSW2026.04 | — | 94.46 | 98.95 | 1.45 | — | — | — | |
| ContrieverIndexing=IVF-Flat2026.04 | — | 94.19 | 99.9 | 1.57 | — | — | — | |
| ContrieverIndexing=IVF-PQ2026.04 | — | 94.73 | 99.9 | 1.51 | — | — | — | |
| GTEIndexing=Flat2026.04 | — | 72.52 | 87.2 | 2.68 | — | — | — | |
| GTEIndexing=HNSW2026.04 | — | 70.25 | 84.15 | 2.63 | — | — | — | |
| GTEIndexing=IVF-Flat2026.04 | — | 73.61 | 88.1 | 2.64 | — | — | — | |
| GTEIndexing=IVF-PQ2026.04 | — | 75.36 | 89.35 | 2.56 | — | — | — |