Information Retrieval on SCIDOCS (test)
16.7NDCG@10Our Model
Evaluation Results
| Method | Links | |
|---|---|---|
| Our ModelRetriever Type=Inference-free Sparse Retriever2024.11 | 16.7 | |
| BM25Retriever Type=Inference-free Sparse Retriever2024.11 | 16.5 | |
| ContrieverRetriever Type=Dense Retriever2024.11 | 16.5 | |
| ContrieverProtocol=Additional training2022.12 | 16.5 | |
| SPLADE++-SelfDistilRetriever Type=Sparse Retriever2024.11 | 15.8 | |
| BM25Protocol=Zero-shot performance2022.12 | 15.8 | |
| ReAttProtocol=Additional training2022.12 | 15.8 | |
| ColBERT-NQProtocol=Zero-shot performance2022.12 | 15.6 | |
| ColBERTv2Retriever Type=Dense Retriever2024.11 | 15.4 | |
| SPLADE-v3-DocRetriever Type=Inference-free Sparse Retriever2024.11 | 15.2 | |
| TAS-BRetriever Type=Dense Retriever2024.11 | 14.9 | |
| SPLADE-v3-DistilRetriever Type=Sparse Retriever2024.11 | 14.8 | |
| ReAttProtocol=Zero-shot performance2022.12 | 14.8 | |
| SPLADE-doc-distillRetriever Type=Inference-free Sparse Retriever2024.11 | 14.7 | |
| ANCEProtocol=Zero-shot performance2022.12 | 12.2 | |
| DPRProtocol=Zero-shot performance2022.12 | 7.7 |