Information Retrieval on Quora (test)
91.6NDCG@10Oracle
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Oraclelambda=0.052026.06 | 91.6 | 22.4 | 17.1 | |
| BGElambda=0.052026.06 | 87.9 | 45.2 | 40.5 | |
| ContrieverRetriever Type=Dense Retriever2024.11 | 86.5 | — | — | |
| Routerlambda=0.052026.06 | 85.6 | 30.2 | 26.4 | |
| ColBERTv2Retriever Type=Dense Retriever2024.11 | 85.2 | — | — | |
| Our ModelRetriever Type=Inference-free Sparse Retriever2024.11 | 84.2 | — | — | |
| SPLADE++-SelfDistilRetriever Type=Sparse Retriever2024.11 | 83.8 | — | — | |
| TAS-BRetriever Type=Dense Retriever2024.11 | 83.5 | — | — | |
| L6lambda=0.052026.06 | 83 | 25.1 | 20 | |
| SPLADE-v3-DistilRetriever Type=Sparse Retriever2024.11 | 81.7 | — | — | |
| BM25Retriever Type=Inference-free Sparse Retriever2024.11 | 78.9 | — | — | |
| SPLADE-v3-DocRetriever Type=Inference-free Sparse Retriever2024.11 | 77.5 | — | — | |
| BM25lambda=0.052026.06 | 77.4 | 17.1 | 11.9 | |
| SPLADE-doc-distillRetriever Type=Inference-free Sparse Retriever2024.11 | 73 | — | — |