Information Retrieval on MS MARCO in-domain
0.473NDCG@10T5-ColBERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| T5-ColBERTRetriever Deployment=One Retriever for All, Model Size=xxl2023.04 | 0.473 | — | — | |
| XTRRetriever Deployment=One Retriever for All, Model Size=xxl2023.04 | 0.466 | — | — | |
| ColBERT v2Retriever Deployment=One Retriever for All, model-based hard negatives=true2023.04 | 0.463 | — | — | |
| T5-ColBERTRetriever Deployment=One Retriever for All, Model Size=base2023.04 | 0.456 | — | — | |
| XTRRetriever Deployment=One Retriever for All, Model Size=base2023.04 | 0.45 | — | — | |
| GTRModel Size=XXL2021.12 | 0.442 | 0.388 | 99 | |
| GTRRetriever Deployment=One Retriever for All, Model Size=xxl2023.04 | 0.442 | — | — | |
| GTRModel Size=XL2021.12 | 0.439 | 0.385 | 98.9 | |
| Splade v2Retriever Deployment=One Retriever for All, model-based hard negatives=true2023.04 | 0.433 | — | — | |
| GTRModel Size=Large2021.12 | 0.43 | 0.379 | 99.1 | |
| GTRModel Size=Base2021.12 | 0.42 | 0.366 | 98.3 | |
| GTRRetriever Deployment=One Retriever for All, Model Size=base2023.04 | 0.42 | — | — | |
| TAS-Balanced2021.12 | 0.408 | 0.34 | 97.5 | |
| GenQRetriever Deployment=One Retriever per Domain2023.04 | 0.408 | — | — | |
| ColBERT2021.12 | 0.401 | 0.36 | 96.8 | |
| ColBERTRetriever Deployment=One Retriever for All2023.04 | 0.401 | — | — | |
| ANCE2021.12 | 0.388 | 0.33 | 95.9 | |
| BM25Retriever Deployment=One Retriever for All2023.04 | 0.228 | — | — | |
| RocketQA2021.12 | — | 0.37 | 97.9 |