Reranking on MS MARCO (dev)
41.4MRR@10RocketQAv2-reranker + HybRank
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| RocketQAv2-reranker + HybRankreranking_extension=HybRank2023.05 | 41.4 | 70.37 | 86.68 | — | — | — | — | — | |
| RocketQAv2-rerankerreranking=HybRank2023.05 | 41.4 | — | — | — | — | — | — | — | |
| RocketQAv2-rerankerreranking_extension=none2023.05 | 41.15 | 69.99 | 86.55 | — | — | — | — | — | |
| RocketQAv2-rerankerreranking=None2023.05 | 41.15 | — | — | — | — | — | — | — | |
| RocketQA-reranker + HybRankreranking_extension=HybRank2023.05 | 40.98 | 70.4 | 86.55 | — | — | — | — | — | |
| RocketQA-rerankerreranking=HybRank2023.05 | 40.98 | — | — | — | — | — | — | — | |
| RocketQA-rerankerreranking_extension=none2023.05 | 40.51 | 69.81 | 86.46 | — | — | — | — | — | |
| RocketQA-rerankerreranking=None2023.05 | 40.51 | — | — | — | — | — | — | — | |
| RocketQAv2-retriever + HybRankreranking_extension=HybRank2023.05 | 38.74 | 68.12 | 85.96 | — | — | — | — | — | |
| RocketQAv2-retrieverreranking=HybRank2023.05 | 38.74 | — | — | — | — | — | — | — | |
| TCT-ColBERT-v2 + HybRankreranking_extension=HybRank2023.05 | 37.55 | 66.39 | 84.97 | — | — | — | — | — | |
| TCT-ColBERT-v2reranking=HybRank2023.05 | 37.55 | — | — | — | — | — | — | — | |
| RocketQAv2-retrieverreranking_extension=none2023.05 | 37.28 | 65.72 | 84.04 | — | — | — | — | — | |
| RocketQAv2-retrieverreranking=None2023.05 | 37.28 | — | — | — | — | — | — | — | |
| RocketQA-retriever + HybRankreranking_extension=HybRank2023.05 | 36.97 | 65.67 | 84.91 | — | — | — | — | — | |
| RocketQA-retrieverreranking=HybRank2023.05 | 36.97 | — | — | — | — | — | — | — | |
| ANCE + HybRankreranking_extension=HybRank2023.05 | 36.44 | 64.63 | 82.79 | — | — | — | — | — | |
| ANCEreranking=HybRank2023.05 | 36.44 | — | — | — | — | — | — | — | |
| TAS-B + HybRankreranking_extension=HybRank2023.05 | 36.38 | 65.77 | 84.71 | — | — | — | — | — | |
| TAS-Breranking=HybRank2023.05 | 36.38 | — | — | — | — | — | — | — | |
| DistilBERT-KD + HybRankreranking_extension=HybRank2023.05 | 36.24 | 64.4 | 82.02 | — | — | — | — | — | |
| DistilBERT-KDreranking=HybRank2023.05 | 36.24 | — | — | — | — | — | — | — | |
| TCT-ColBERT-v1 + HybRankreranking_extension=HybRank2023.05 | 36.23 | 64.96 | 83.44 | — | — | — | — | — | |
| TCT-ColBERT-v1reranking=HybRank2023.05 | 36.23 | — | — | — | — | — | — | — | |
| TCT-ColBERT-v2reranking_extension=none2023.05 | 35.85 | 63.64 | 83.31 | — | — | — | — | — | |
| TCT-ColBERT-v2reranking=None2023.05 | 35.85 | — | — | — | — | — | — | — | |
| RocketQA-retrieverreranking_extension=none2023.05 | 35.77 | 64.01 | 83.41 | — | — | — | — | — | |
| RocketQA-retrieverreranking=None2023.05 | 35.77 | — | — | — | — | — | — | — | |
| TAS-Breranking_extension=none2023.05 | 34.44 | 62.94 | 83.44 | — | — | — | — | — | |
| TAS-Breranking=None2023.05 | 34.44 | — | — | — | — | — | — | — | |
| TCT-ColBERT-v1reranking_extension=none2023.05 | 33.49 | 60.46 | 80.67 | — | — | — | — | — | |
| TCT-ColBERT-v1reranking=None2023.05 | 33.49 | — | — | — | — | — | — | — | |
| ANCEreranking_extension=none2023.05 | 33.01 | 59.44 | 80.1 | — | — | — | — | — | |
| ANCEreranking=None2023.05 | 33.01 | — | — | — | — | — | — | — | |
| DistilBERT-KDreranking_extension=none2023.05 | 32.5 | 58.77 | 79.24 | — | — | — | — | — | |
| DistilBERT-KDreranking=None2023.05 | 32.5 | — | — | — | — | — | — | — | |
| ColBERT-v2Number of parameters=110M, Backbone=BERT-base2026.01 | 0.397 | — | — | — | — | — | — | — | |
| ColBERT (sum-max)Number of parameters=67.5M, Backbone=small-bert2026.01 | 0.384 | — | — | — | — | — | — | 44.3 | |
| SPLADE + CoCondenser-EnsembleDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 0.38 | — | — | — | — | — | — | — | |
| SPLADE + CoCondenser-SelfDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 0.375 | — | — | — | — | — | — | — | |
| FastLaneNumber of parameters=67.5M, Backbone=small-bert2026.01 | 0.372 | — | — | — | — | — | — | 43 | |
| SPLADE + EnsembleDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 0.369 | — | — | — | — | — | — | — | |
| SPLADE + SelfDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 0.368 | — | — | — | — | — | — | — | |
| ColBERT (end-to-end)Number of parameters=110M, Backbone=BERT-base2026.01 | 0.36 | — | — | — | — | — | — | 40 | |
| SPLADE + DistilMSENumber of parameters=66M, Backbone=distilBERT2026.01 | 0.358 | — | — | — | — | — | — | — | |
| ColBERT (re-rank)Number of parameters=110M, Backbone=BERT-base2026.01 | 0.348 | — | — | — | — | — | — | — | |
| RoBERTa-base + Exhaustive NegativesNumber of parameters=123M, Backbone=RoBERTa-base2026.01 | 0.345 | — | — | — | — | — | — | — | |
| Dual-encoder BERT (6-layer)Number of parameters=67.5M, Backbone=small-bert2026.01 | 0.344 | — | — | — | — | — | — | 40.4 | |
| SPLADE (simple training)Number of parameters=110M, Backbone=BERT-base2026.01 | 0.342 | — | — | — | — | — | — | — | |
| RepCONCNumber of parameters=123M, Backbone=RoBERTa-base2026.01 | 0.34 | — | — | — | — | — | — | — | |
| RoBERTa-base + DyNNIBALNumber of parameters=123M, Backbone=RoBERTa-base2026.01 | 0.334 | — | — | — | — | — | — | — | |
| RoBERTa-base + Stochastic NegativesNumber of parameters=123M, Backbone=RoBERTa-base2026.01 | 0.331 | — | — | — | — | — | — | — | |
| RoBERTa-base + Negative CacheNumber of parameters=123M, Backbone=RoBERTa-base2026.01 | 0.331 | — | — | — | — | — | — | — | |
| ANCE2026.01 | 0.33 | — | — | — | — | — | — | 38.8 | |
| RoBERTa-base + Uniform NegativesNumber of parameters=123M, Backbone=RoBERTa-base2026.01 | 0.305 | — | — | — | — | — | — | — | |
| CCSANumber of parameters=110M, Backbone=BERT-base2026.01 | 0.289 | — | — | — | — | — | — | — | |
| HNSW2026.01 | 0.289 | — | — | — | — | — | — | — | |
| DSI (Atomic Docid + Doc2Query + Base Model)Number of parameters=250M, Backbone=T5-base2026.01 | 0.26 | — | — | — | — | — | — | 32.28 | |
| DeepCTNumber of parameters=110M, Backbone=BERT-base2026.01 | 0.243 | — | — | — | — | — | — | 29.6 | |
| RoBERTa-base + In-batch NegativesNumber of parameters=123M, Backbone=RoBERTa-base2026.01 | 0.242 | — | — | — | — | — | — | — | |
| cpt-text XLNumber of parameters=175B, Backbone=cpt-text XL2026.01 | 0.227 | — | — | — | — | — | — | — | |
| cpt-text LNumber of parameters=6B, Backbone=cpt-text L2026.01 | 0.215 | — | — | — | — | — | — | — | |
| doc2query2026.01 | 0.215 | — | — | — | — | — | — | — | |
| DSI (Naive String Docid + Doc2Query + XL Model)Number of parameters=3B, Backbone=T5-XL2026.01 | 0.21 | — | — | — | — | — | — | — | |
| docTTTTquery2026.01 | 0.2077 | — | — | — | — | — | — | — | |
| cpt-text MNumber of parameters=1.2B, Backbone=cpt-text M2026.01 | 0.206 | — | — | — | — | — | — | — | |
| DSI (Semantic String Docid + Doc2Query + XL Model)Number of parameters=3B, Backbone=T5-XL2026.01 | 0.203 | — | — | — | — | — | — | 27.86 | |
| cpt-text SNumber of parameters=300M, Backbone=cpt-text S2026.01 | 0.199 | — | — | — | — | — | — | — | |
| BM25 (Anserini)2026.01 | 0.187 | — | — | — | — | — | — | — | |
| BM25 (official)2026.01 | 0.167 | — | — | — | — | — | — | 22.8 | |
| DSI (Naive String Docid + Doc2Query + XXL Model)Number of parameters=11B, Backbone=T5-XXL2026.01 | 0.165 | — | — | — | — | — | — | — | |
| Backward BaselineInference Direction=Q -> D2024.12 | — | — | — | 16.8 | 14.04 | 15.99 | 53.13 | 52.07 | |
| BM25 + CE2026.01 | — | — | — | — | — | — | — | 41.3 | |
| docT5query2026.01 | — | — | — | — | — | — | — | 33.8 | |
| DPRNumber of parameters=110M, Backbone=BERT-base2026.01 | — | — | — | — | — | — | — | 17.7 | |
| Forward BaselineInference Direction=Q -> D2024.12 | — | — | — | 21.05 | 13.82 | 18.42 | 47.81 | 53 | |
| GenQ2026.01 | — | — | — | — | — | — | — | 40.8 | |
| SGPT-BE-5.8BNumber of parameters=5.8B, Backbone=GPT-J2026.01 | — | — | — | — | — | — | — | 39.9 | |
| SGPT-CE-2.7BNumber of parameters=2.7B, Backbone=GPT-Neo2026.01 | — | — | — | — | — | — | — | 27.8 | |
| SGPT-CE-6.1BNumber of parameters=6.1B, Backbone=GPT-J-6B2026.01 | — | — | — | — | — | — | — | 29 | |
| SPARTANumber of parameters=110M, Backbone=BERT-base2026.01 | — | — | — | — | — | — | — | 35.1 | |
| TAS-BNumber of parameters=110M, Backbone=BERT-base2026.01 | — | — | — | — | — | — | — | 40.8 | |
| TRLM-BaInference Direction=D -> Q2024.12 | — | — | — | 28.4 | 18.54 | 27.22 | 70.29 | 61.49 | |
| TRLM-FoInference Direction=D -> Q2024.12 | — | — | — | 20.37 | 14.9 | 19.45 | 56.39 | 54.46 | |
| TRLM-FoBa (Forward)Inference Direction=D -> Q2024.12 | — | — | — | 21.16 | 15.58 | 20.25 | 59.08 | 55.46 | |
| TRLM-FoBa (Reverse)Inference Direction=D -> Q2024.12 | — | — | — | 24.9 | 17.38 | 23.85 | 65.85 | 58.84 |