Document Ranking on TREC DL Track 2019 (test)
77.05nDCG@10RocketQA-reranker + HybRank
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RocketQA-reranker + HybRankreranking_extension=HybRank2023.05 | 77.05 | — | — | — | |
| RocketQA-rerankerreranking=HybRank2023.05 | 77.05 | — | — | — | |
| ColBERT (sum-max)Number of parameters=67.5M, Backbone=small-bert2026.01 | 75.7 | — | — | — | |
| RankGPTTraining=GPT-42026.01 | 75.6 | — | — | — | |
| RocketQA-rerankerreranking_extension=none2023.05 | 75.4 | — | — | — | |
| RocketQA-rerankerreranking=None2023.05 | 75.4 | — | — | — | |
| FastLaneNumber of parameters=67.5M, Backbone=small-bert2026.01 | 75.4 | — | — | — | |
| RocketQAv2-reranker + HybRankreranking_extension=HybRank2023.05 | 74.92 | — | — | — | |
| RocketQAv2-rerankerreranking=HybRank2023.05 | 74.92 | — | — | — | |
| Cross-attention BERT (12-layer)Number of parameters=110M, Backbone=BERT-base2026.01 | 74.9 | — | — | — | |
| TAS-B + HybRankreranking_extension=HybRank2023.05 | 74.82 | — | — | — | |
| TAS-Breranking=HybRank2023.05 | 74.82 | — | — | — | |
| RocketQA-retriever + HybRankreranking_extension=HybRank2023.05 | 74.79 | — | — | — | |
| RocketQA-retrieverreranking=HybRank2023.05 | 74.79 | — | — | — | |
| Rank-Nexus-2BTraining=LLM-distil., Scale (%)=7.52026.01 | 74.6 | — | — | — | |
| Dual-encoder BERT (6-layer)Number of parameters=67.5M, Backbone=small-bert2026.01 | 74.2 | — | — | — | |
| TCT-ColBERT-v2 + HybRankreranking_extension=HybRank2023.05 | 74.06 | — | — | — | |
| TCT-ColBERT-v2reranking=HybRank2023.05 | 74.06 | — | — | — | |
| RankZephyr-7BTraining=LLM-distil., Scale (%)=1002026.01 | 73.9 | — | — | — | |
| Setwise-Rank-R1-7BTraining=SFT, Scale (%)=182026.01 | 73.8 | — | — | — | |
| RocketQAv2-retriever + HybRankreranking_extension=HybRank2023.05 | 73.63 | — | — | — | |
| RocketQAv2-retrieverreranking=HybRank2023.05 | 73.63 | — | — | — | |
| Setwise-Rank-R1-3BTraining=SFT, Scale (%)=182026.01 | 73.4 | — | — | — | |
| RocketQAv2-rerankerreranking_extension=none2023.05 | 73.24 | — | — | — | |
| RocketQAv2-rerankerreranking=None2023.05 | 73.24 | — | — | — | |
| TCT-ColBERT-v1 + HybRankreranking_extension=HybRank2023.05 | 73.21 | — | — | — | |
| TCT-ColBERT-v1reranking=HybRank2023.05 | 73.21 | — | — | — | |
| SPLADE + CoCondenser-EnsembleDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 73.2 | — | — | — | |
| SPLADE + CoCondenser-SelfDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 73 | — | — | — | |
| Setwise-Rank-R1-14BTraining=SFT, Scale (%)=182026.01 | 72.9 | — | — | — | |
| SPLADE + DistilMSENumber of parameters=66M, Backbone=distilBERT2026.01 | 72.9 | — | — | — | |
| Rank-R1-7BTraining=RL, Scale (%)=182026.01 | 72.7 | — | — | — | |
| DistilBERT + Softmax CENumber of parameters=66M, Backbone=distilBERT2026.01 | 72.6 | — | — | — | |
| DistilBERT-KD + HybRankreranking_extension=HybRank2023.05 | 72.55 | — | — | — | |
| DistilBERT-KDreranking=HybRank2023.05 | 72.55 | — | — | — | |
| SPLADE + SelfDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 72.3 | — | — | — | |
| SPLADE + EnsembleDistilNumber of parameters=66M, Backbone=distilBERT2026.01 | 72.1 | — | — | — | |
| idst_bert_r1Group=TREC2020.08 | 71.9 | 29.1 | — | — | |
| ListT5-baseTraining=SFT, Scale (%)=1002026.01 | 71.8 | — | — | — | |
| DistilBERT + Margin MSENumber of parameters=66M, Backbone=distilBERT2026.01 | 71.8 | — | — | — | |
| ColBERTRetrieval mode=Re-ranking, First-stage Retrieval=BM252022.03 | 71.4 | — | — | — | |
| Rank-R1-14BTraining=RL, Scale (%)=182026.01 | 71.4 | — | — | — | |
| DistilBERT + M3SENumber of parameters=66M, Backbone=distilBERT2026.01 | 71.4 | — | — | — | |
| Rank-R1-3BTraining=RL, Scale (%)=182026.01 | 71.3 | — | — | — | |
| ColBERT-CQRetrieval mode=Quantized Re-ranking, First-stage Retrieval=BM25, Quantization method=CQ2022.03 | 71.2 | — | — | — | |
| Rank-R1-7BTraining=Zeroshot, Scale (%)=1002026.01 | 71.2 | — | — | — | |
| TCT-ColBERT-v2reranking_extension=none2023.05 | 71.15 | — | — | — | |
| TCT-ColBERT-v2reranking=None2023.05 | 71.15 | — | — | — | |
| PSI-Rank_{Dyn,Avg}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=19.52026.04 | 71.1 | 36.2 | — | — | |
| DistilBERT + RankDistil-BNumber of parameters=66M, Backbone=distilBERT2026.01 | 70.8 | — | — | — | |
| PSI-Rank_{Avg}Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=19.72026.04 | 70.8 | 36.2 | — | — | |
| PSI-Rank_{Avg,Avg}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=19.72026.04 | 70.8 | 36.2 | — | — | |
| ColBERT-LSQRetrieval mode=Quantized Re-ranking, First-stage Retrieval=BM25, Quantization method=LSQ2022.03 | 70.7 | — | — | — | |
| PSI-Rank_{Dyn,Dyn}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=55.12026.04 | 70.6 | 36 | — | — | |
| TAS-Breranking_extension=none2023.05 | 70.49 | — | — | — | |
| RocketQA-retrieverreranking_extension=none2023.05 | 70.49 | — | — | — | |
| TAS-Breranking=None2023.05 | 70.49 | — | — | — | |
| RocketQA-retrieverreranking=None2023.05 | 70.49 | — | — | — | |
| ANCE + HybRankreranking_extension=HybRank2023.05 | 70.41 | — | — | — | |
| ANCEreranking=HybRank2023.05 | 70.41 | — | — | — | |
| ColBERT-OPQRetrieval mode=Quantized Re-ranking, First-stage Retrieval=BM25, Quantization method=OPQ2022.03 | 70.4 | — | — | — | |
| ColBERT-RQRetrieval mode=Quantized Re-ranking, First-stage Retrieval=BM25, Quantization method=RQ2022.03 | 70.4 | — | — | — | |
| +mono-T5 (100) + duo-T5 (50)Pipeline Configuration=Fixed-k, IPQ=49.02026.04 | 70.3 | 36 | — | — | |
| ColBERT-PQRetrieval mode=Quantized Re-ranking, First-stage Retrieval=BM25, Quantization method=PQ2022.03 | 70.2 | — | — | — | |
| RocketQAv2-retrieverreranking_extension=none2023.05 | 70.14 | — | — | — | |
| RocketQAv2-retrieverreranking=None2023.05 | 70.14 | — | — | — | |
| +mono-T5 (100)Pipeline Configuration=Fixed-k, IPQ=97.82026.04 | 70.1 | 35.8 | — | — | |
| PSI-Rank_{Avg,Dyn}Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=7.02026.04 | 70.1 | 35.9 | — | — | |
| Choppy (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=45.02026.04 | 70 | 33.3 | — | — | |
| SPLADE (simple training)Number of parameters=110M, Backbone=BERT-base2026.01 | 69.9 | — | — | — | |
| PSI-Rank_{Dyn}Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=28.02026.04 | 69.9 | 35.4 | — | — | |
| Greedy-k (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=43.02026.04 | 69.8 | 34.2 | — | — | |
| AttnCut (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=41.92026.04 | 69.5 | 33 | — | — | |
| Choppy (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=41.92026.04 | 69.5 | 33.5 | — | — | |
| DistilBERT + MSENumber of parameters=66M, Backbone=distilBERT2026.01 | 69.3 | — | — | — | |
| DistilBERT-KDreranking_extension=none2023.05 | 69.23 | — | — | — | |
| DistilBERT-KDreranking=None2023.05 | 69.23 | — | — | — | |
| Greedy-k (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=39.12026.04 | 69.2 | 34.8 | — | — | |
| MtCut (β = 2)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=40.72026.04 | 69 | 32.8 | — | — | |
| AttnCut (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=40.72026.04 | 69 | 33.2 | — | — | |
| RankVicuna-7bTraining=Zeroshot, Scale (%)=1002026.01 | 68.9 | — | — | — | |
| PSI-Rank_{Avg}Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=55.82026.04 | 68.5 | 33.7 | — | — | |
| MtCut (β = 2, β = 2)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=39.52026.04 | 68.5 | 32.5 | — | — | |
| PARADE-MaxGroup=Ours2020.08 | 67.9 | 28.7 | — | — | |
| Rank-R1-14BTraining=Zeroshot, Scale (%)=1002026.01 | 67.9 | — | — | — | |
| Setwise-14BTraining=Zeroshot, Scale (%)=1002026.01 | 67.7 | — | — | — | |
| Setwise-Rank-R1-7BTraining=Zeroshot, Scale (%)=1002026.01 | 67.5 | — | — | — | |
| BiCut (η = 0.6)Pipeline Configuration=BM25 (100) → mono-T5 (∞) → duo-T5, IPQ=45.02026.04 | 67.5 | 31.5 | — | — | |
| SumRankparameters=7B2026.03 | 67.3 | — | — | 28.81 | |
| SumRankparameters=3B2026.03 | 67.06 | — | — | 28.53 | |
| BERT-baseRetrieval mode=Re-ranking, First-stage Retrieval=BM252022.03 | 67 | — | — | — | |
| BiCut (η = 0.6, η = 0.6)Pipeline Configuration=BM25 (∞) → mono-T5 (∞) → duo-T5, IPQ=43.02026.04 | 66.8 | 31.2 | — | — | |
| Choppy (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=70.02026.04 | 66.5 | 32.1 | — | — | |
| AttnCut (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=47.02026.04 | 66 | 31.8 | — | — | |
| FirstPtruncation_length=5122026.03 | 65.94 | — | — | 27.54 | |
| RankGPT(GPT-3.5)Training=GPT-3.52026.01 | 65.8 | — | — | — | |
| Greedy-k (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=67.02026.04 | 65.5 | 32.3 | — | — | |
| MtCut (β = 2)Pipeline Configuration=BM25 (∞) → mono-T5, IPQ=44.22026.04 | 65.5 | 30.8 | — | — | |
| TCT-ColBERT-v1reranking_extension=none2023.05 | 65.42 | — | — | — | |
| TCT-ColBERT-v1reranking=None2023.05 | 65.42 | — | — | — |