Information Retrieval on BEIR (test)
91.6TREC-COVID ScoreUnIte
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| UnIteRetriever=Qwen3 (4B), Adaptation Method=UnIte2026.04 | 91.6 | — | — | — | — | — | — | — | 48.68 | 62.31 | — | — | — | 88.62 | — | — | — | — | — | 72.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3 (4B)Retriever=Qwen3 (4B), Adaptation Method=—2026.04 | 88.91 | — | — | — | — | — | — | — | 21.17 | 62.27 | — | — | — | 88.3 | — | — | — | — | — | 65.16 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPLRetriever=Qwen3 (4B), Adaptation Method=GPL2026.04 | 88.81 | — | — | — | — | — | — | — | 21.89 | 59.84 | — | — | — | 88.28 | — | — | — | — | — | 64.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DUQGenRetriever=Qwen3 (4B), Adaptation Method=DUQGen2026.04 | 88.6 | — | — | — | — | — | — | — | 43.82 | 60.9 | — | — | — | 83.9 | — | — | — | — | — | 69.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnIteRetriever=COCO-DR, Adaptation Method=UnIte2026.04 | 80.02 | — | — | — | — | 60.56 | — | — | 38.31 | 45.29 | — | — | — | 87.16 | — | — | — | — | — | 62.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| COCO-DRRetriever=COCO-DR, Adaptation Method=—2026.04 | 79.34 | — | — | — | — | 60.43 | — | — | 38.61 | 44.64 | — | — | — | 86.73 | — | — | — | — | — | 61.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RandomRetriever=COCO-DR, Adaptation Method=Random2026.04 | 79.18 | — | — | — | — | 60.53 | — | — | 38.34 | 44.8 | — | — | — | 87.05 | — | — | — | — | — | 61.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DUQGenRetriever=COCO-DR, Adaptation Method=DUQGen2026.04 | 79.16 | — | — | — | — | 60.84 | — | — | 37.84 | 45.05 | — | — | — | 87.15 | — | — | — | — | — | 62.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QualityRetriever=COCO-DR, Adaptation Method=Quality2026.04 | 79.12 | — | — | — | — | 60.6 | — | — | 37.96 | 45.09 | — | — | — | 86.88 | — | — | — | — | — | 61.93 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPLRetriever=COCO-DR, Adaptation Method=GPL2026.04 | 78.38 | — | — | — | — | 59.82 | — | — | 37.3 | 43.72 | — | — | — | 86.95 | — | — | — | — | — | 61.23 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25re-ranking=Cross-Encoder (CE)2021.12 | 75.7 | 41.3 | — | 35 | 53.3 | 70.7 | 34.7 | — | — | — | 31.1 | 27.1 | 37 | 82.5 | 40.9 | 16.6 | 81.9 | 25.3 | 68.8 | 48.6 | — | 49.5 | 3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ST5 GPLRetrieval Category=Dense retrieval, Training=Sentence-T5 trained on GPL datasets2023.04 | 74.4 | — | — | 30.1 | — | — | 26 | — | — | — | 32.1 | — | — | — | — | 12.7 | — | — | 58.6 | 39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ColBERTRep type=Mul-vec, Distillation=false, Protocol=Zero-shot, Version=v22022.12 | 73.8 | — | — | 33.8 | 56.2 | 66.7 | 35.6 | — | — | — | 46.3 | 26.3 | — | — | 44.6 | 15.4 | 78.5 | 17.6 | 69.3 | 47 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ColBERTv2Distillation=true, Zero-shot=true2021.12 | 73.8 | — | — | 33.8 | 56.2 | 66.7 | 35.6 | — | — | — | — | 26.3 | — | — | 44.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ANCERetrieval Category=Dense retrieval2023.04 | 73.3 | — | — | 23.1 | — | — | 29.5 | — | — | — | 31.4 | — | — | — | — | 12.2 | — | — | 50.8 | 36.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ADAMRep type=Dense, Distillation=true, Protocol=Zero-shot2022.12 | 73 | — | — | 31.5 | 51.9 | 58.6 | 31.5 | — | — | — | 40.3 | 25.6 | — | — | 39.6 | 14.1 | 66.8 | 21.4 | 59.4 | 42.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GenRetRetrieval Category=Generative retrieval2023.04 | 71.8 | — | — | 31.6 | — | — | 30.2 | — | — | — | 34.3 | — | — | — | — | 14.9 | — | — | 63.9 | 41.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnifieRRep type=Mul-vec, Distillation=false, Protocol=Zero-shot2022.12 | 71.5 | — | — | 32.9 | 51.4 | 66.1 | 31.1 | — | — | — | 39 | 30.2 | — | — | 40.6 | 15 | 69.6 | 17.5 | 68.6 | 44.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DocT5QueryRetrieval Category=Sparse retrieval2023.04 | 71.3 | — | — | 32.8 | — | — | 29.1 | — | — | — | 34.9 | — | — | — | — | 16.2 | — | — | 67.5 | 41.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CoCondRep type=Dense, Distillation=true, Protocol=Zero-shot2022.12 | 71.2 | — | — | 32.5 | 48.7 | 56.3 | 27.6 | — | — | — | 29.9 | 19.1 | — | — | 36.3 | 13.7 | 49.5 | 14.4 | 61.5 | 38.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnIteRetriever=coCondenser, Adaptation Method=UnIte2026.04 | 71.02 | — | — | — | — | 55.14 | — | — | 31.16 | 33.95 | — | — | — | 87.17 | — | — | — | — | — | 55.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Splade v2Retrieval architecture=Bi-encoder2021.12 | 71 | 43.3 | — | 33.4 | 52.1 | 68.4 | 33.6 | — | — | — | 47.9 | 36.4 | — | 83.8 | 43.5 | 15.8 | 78.6 | 23.5 | 69.3 | — | — | 50.6 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SPLADERep type=Sparse, Distillation=true, Protocol=Zero-shot2022.12 | 71 | — | — | 33.4 | 52.1 | 68.4 | 33.6 | — | — | — | 47.9 | 27.2 | — | — | 43.5 | 15.8 | 78.6 | 23.5 | 69.3 | 42.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SPLADEV2Distillation=true, Zero-shot=true2021.12 | 71 | — | — | 33.4 | 52.1 | 68.4 | 33.6 | — | — | — | — | 27.2 | — | — | 43.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DUQGenRetriever=coCondenser, Adaptation Method=DUQGen2026.04 | 70.35 | — | — | — | — | 56.77 | — | — | 28.02 | 32.42 | — | — | — | 87.12 | — | — | — | — | — | 54.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContrieverRetrieval architecture=Bi-encoder, re-ranking=Cross-Encoder (CE)2021.12 | 70.1 | 47 | — | 34.4 | 57.7 | 71.5 | 36.7 | — | — | — | 41.3 | 29.8 | 37.7 | 82.4 | 47.1 | 17.1 | 81.9 | 25.8 | 69.2 | 50.2 | — | 51.2 | 9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContrieverRetrieval Category=Dense retrieval2023.04 | 68.8 | — | — | 33.5 | — | — | 30.7 | — | — | — | 40 | — | — | — | — | 16.3 | — | — | 61.4 | 41.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ColBERTRetrieval architecture=Bi-encoder (Late Interaction)2021.12 | 67.7 | 40.1 | — | 30.5 | 52.4 | 59.3 | 31.7 | — | — | — | 23.3 | 20.2 | 35 | 85.4 | 39.2 | 14.5 | 77.1 | 18.4 | 67.1 | 44.4 | — | 45.1 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ColBERTDistillation=false, Zero-shot=true2021.12 | 67.7 | — | — | 30.5 | 52.4 | 59.3 | 31.7 | — | — | — | — | — | — | — | 39.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MODIRDistillation=false, Zero-shot=true2021.12 | 67.6 | — | — | 24.4 | 44.2 | 46.2 | 29.6 | — | — | — | — | — | — | — | 28.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RocQARep type=Dense, Distillation=true, Protocol=Zero-shot2022.12 | 67.5 | — | — | 29.3 | 50.5 | 53.3 | 30.2 | — | — | — | 45.1 | 24.7 | — | — | 35.6 | 13.1 | 67.6 | 18 | 56.8 | 41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RocketQAv2Distillation=true, Zero-shot=true2021.12 | 67.5 | — | — | 29.3 | 50.5 | 53.3 | 30.2 | — | — | — | — | 24.7 | — | — | 35.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| coCondenserRetriever=coCondenser, Adaptation Method=—2026.04 | 67.48 | — | — | — | — | 54.44 | — | — | 28.9 | 32.51 | — | — | — | 86.36 | — | — | — | — | — | 53.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnIteRetriever=DPR, Adaptation Method=UnIte2026.04 | 66.79 | — | — | — | — | 40.82 | — | — | 29.13 | 33.23 | — | — | — | 75.32 | — | — | — | — | — | 49.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RandomRetriever=coCondenser, Adaptation Method=Random2026.04 | 66.35 | — | — | — | — | 56 | — | — | 28.14 | 32.26 | — | — | — | 87.12 | — | — | — | — | — | 53.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25re-ranking=none2021.12 | 65.6 | 22.8 | — | 32.5 | 32.9 | 60.3 | 23.6 | — | — | — | 31.5 | 36.7 | 29.9 | 78.9 | 31.3 | 15.8 | 75.3 | 21.3 | 66.5 | 43 | — | 44 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Rep type=Sparse, Distillation=false, Protocol=Zero-shot2022.12 | 65.6 | — | — | 32.5 | 32.9 | 60.3 | 23.6 | — | — | — | 31.5 | 36.7 | — | — | 31.3 | 15.8 | 75.3 | 21.3 | 66.5 | 41.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Retriever=BM25, Adaptation Method=—2026.04 | 65.59 | — | — | — | — | 60.3 | — | — | 39.8 | 40.7 | — | — | — | 78.9 | — | — | — | — | — | 44.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ANCERetrieval architecture=Bi-encoder2021.12 | 65.4 | 38.8 | — | 23.7 | 44.6 | 45.6 | 29.5 | — | — | — | 41.5 | 24 | 29.6 | 85.2 | 28.1 | 12.2 | 66.9 | 19.8 | 50.7 | 40.5 | — | 41.3 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ANCErelevance judgement=w/2022.12 | 65.4 | — | — | — | — | — | 30 | — | 38.2 | — | 41.5 | — | — | — | 28.1 | — | — | — | 50.7 | — | — | — | — | — | 81.6 | 93.7 | 45.7 | 58.1 | 31.9 | 39.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ANCERep type=Dense, Distillation=true, Protocol=Zero-shot2022.12 | 65.4 | — | — | 23.7 | 44.6 | 45.6 | 29.5 | — | — | — | 41.5 | 24 | — | — | 28.1 | 12.2 | 66.9 | 19.8 | 50.7 | 37.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ANCEDistillation=false, Zero-shot=true2021.12 | 65.4 | — | — | 23.7 | 44.6 | 45.6 | 29.5 | — | — | — | — | — | — | — | 28.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QualityRetriever=coCondenser, Adaptation Method=Quality2026.04 | 63.67 | — | — | — | — | 56.17 | — | — | 31.95 | 31.36 | — | — | — | 86.61 | — | — | — | — | — | 53.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DUQGenRetriever=DPR, Adaptation Method=DUQGen2026.04 | 62.75 | — | — | — | — | 39.62 | — | — | 24.05 | 31.48 | — | — | — | 75.17 | — | — | — | — | — | 46.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gen-QRetrieval architecture=Bi-encoder2021.12 | 61.9 | 40.8 | — | 31.9 | 35.8 | 53.4 | 30.8 | — | — | — | 49.3 | 18.2 | 34.7 | 83 | 32.8 | 14.3 | 66.9 | 17.5 | 64.4 | 42.5 | — | 43.1 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GTR-BaseRetrieval Category=Dense retrieval, Implementation=Re-implementation2023.04 | 61.2 | — | — | 30 | — | — | 35.1 | — | — | — | 37.3 | — | — | — | — | 14 | — | — | 58.4 | 39.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QualityRetriever=DPR, Adaptation Method=Quality2026.04 | 61.11 | — | — | — | — | 39.35 | — | — | 23.42 | 28.25 | — | — | — | 75.01 | — | — | — | — | — | 45.43 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RandomRetriever=DPR, Adaptation Method=Random2026.04 | 60.81 | — | — | — | — | 38.02 | — | — | 28.66 | 31.11 | — | — | — | 74.01 | — | — | — | — | — | 46.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContrieverRetrieval architecture=Bi-encoder, re-ranking=none2021.12 | 59.6 | 40.7 | — | 32.8 | 49.8 | 63.8 | 32.9 | — | — | — | 44.6 | 23 | 34.5 | 86.5 | 41.3 | 16.5 | 75.8 | 23.7 | 67.7 | 46.6 | — | 47.5 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContrieverFTrelevance judgement=w/2022.12 | 59.6 | — | — | — | — | — | 32.9 | — | 42.8 | — | 44.6 | — | — | — | 41.3 | — | — | — | 67.7 | — | — | — | — | — | 94.7 | 97.7 | 40.7 | 65.6 | 54.1 | 49.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25relevance judgement=w/o2022.12 | 59.5 | — | — | — | — | — | 23.6 | — | 39.5 | — | 39.7 | — | — | — | 31.8 | — | — | — | 67.9 | — | — | — | — | — | 92.5 | 93.2 | 49.8 | 54 | 46.8 | 44.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HyDErelevance judgement=w/o2022.12 | 59.3 | — | — | — | — | — | 27.3 | — | 44 | — | 46.6 | — | — | — | 36.8 | — | — | — | 69.1 | — | — | — | — | — | 96.4 | 97.9 | 41.4 | 62.1 | 47.2 | 50.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Retrieval Category=Sparse retrieval2023.04 | 58.9 | — | — | 33.5 | — | — | 23.6 | — | — | — | 29.1 | — | — | — | — | 14.8 | — | — | 67.4 | 37.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CL-DRDRep type=Dense, Distillation=true, Protocol=Zero-shot2022.12 | 58.4 | — | — | 31.5 | 50 | 58.9 | 30.8 | — | — | — | 41.3 | 20.3 | — | — | 38.1 | 14.6 | 73.4 | 20.4 | 62.1 | 42 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPR-MDistillation=false, Zero-shot=true2021.12 | 56.1 | — | — | 20.8 | 39.8 | 37.1 | 27.5 | — | — | — | — | — | — | — | 23.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Type=Sparse Retrieval2021.12 | 49.8 | 65.8 | — | 25 | 76 | 74 | 53.9 | — | — | — | 94.2 | 53.8 | 60.6 | 97.3 | 39.8 | 35.6 | 93.1 | 43.6 | 90.8 | 63.4 | — | 63.6 | 2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TAS-BRetrieval architecture=Bi-encoder2021.12 | 48.1 | 40.8 | — | 31.9 | 46.3 | 58.4 | 30 | — | — | — | 42.9 | 16.2 | 31.4 | 83.5 | 38.4 | 14.9 | 70 | 22.8 | 64.3 | 42.8 | — | 43.7 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TAS-BRep type=Dense, Distillation=false, Protocol=Zero-shot2022.12 | 48.1 | — | — | 31.9 | 46.3 | 58.4 | 30 | — | — | — | 42.9 | 16.2 | — | — | 38.4 | 14.9 | 70 | 22.8 | 64.3 | 40.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TAS-BDistillation=true, Zero-shot=true2021.12 | 48.1 | — | — | 31.9 | 46.3 | 58.4 | 30 | — | — | — | — | — | — | — | 38.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ColBERTType=Late Interaction2021.12 | 46.4 | 86.5 | — | 25.4 | 91.2 | 74.8 | 60.3 | — | — | — | 91.4 | 43.9 | 62.4 | 98.9 | 46.1 | 34.4 | 93.4 | 44.4 | 87.8 | 64.3 | — | 64.5 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ANCEbi-encoder=true2021.12 | 45.7 | 85.2 | — | 23.2 | 83.6 | 57.8 | 58.1 | — | — | — | 93.7 | 45.8 | 57.9 | 98.7 | 31.9 | 26.9 | 90 | 44.5 | 81.6 | 60 | — | 60.1 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gen-Qbi-encoder=true2021.12 | 45.6 | 88.4 | — | 28 | 86.2 | 67.3 | 61.8 | — | — | — | 97.8 | 45.1 | 65.4 | 98.8 | 43.3 | 33.2 | 92.8 | 45 | 89.3 | 64.2 | — | 64.2 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Contrieverbi-encoder=true2021.12 | 40.7 | 89.1 | — | 30 | 92.5 | 77.7 | 65.6 | — | — | — | 97.7 | 29.4 | 66.3 | 99.3 | 54.1 | 37.8 | 94.9 | 57.4 | 94.7 | 67 | — | 67.1 | 7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TAS-Bbi-encoder=true2021.12 | 38.7 | 88.4 | — | 28 | 90.3 | 72.8 | 59.3 | — | — | — | 94.2 | 43.1 | 62.2 | 98.6 | 49.9 | 33.5 | 93.7 | 53.4 | 89.1 | 64.8 | — | 65 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPRRetrieval architecture=Bi-encoder2021.12 | 33.2 | 17.7 | — | 18.9 | 47.4 | 39.1 | 11.2 | — | — | — | 17.5 | 13.1 | 15.3 | 24.8 | 26.3 | 7.7 | 56.2 | 14.8 | 31.8 | 25.5 | — | 26.3 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPRrelevance judgement=w/2022.12 | 33.2 | — | — | — | — | — | 29.5 | — | 16.1 | — | 17.5 | — | — | — | 26.3 | — | — | — | 31.8 | — | — | — | — | — | 72.7 | 75.1 | 21.2 | 34.2 | 34.9 | 21.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPRRep type=Dense, Distillation=false, Protocol=Zero-shot2022.12 | 33.2 | — | — | 18.9 | 47.4 | 39.1 | 11.2 | — | — | — | 17.5 | 13.1 | — | — | 26.3 | 7.7 | 56.2 | 14.8 | 31.8 | 26.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPRRetriever=DPR, Adaptation Method=— †2026.04 | 33.2 | — | — | — | — | 39.1 | — | — | 16.1 | 25.2 | — | — | — | 24.8 | — | — | — | — | — | 27.68 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Our rewriterSetting=Zero-shot, Retriever=Contriever, Query Rewriter=Learned RL Agent2026.06 | 32.08 | 49.23 | — | 26.71 | 36.28 | 52.44 | 16.17 | — | — | — | 32.75 | 7.68 | — | 77.27 | 32.18 | 13.1 | 37.52 | 11.75 | 64.54 | 34.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LSEPairtraining_mode=Zero-shot, metric_type=NDCG@102026.02 | 31.1 | — | — | 25.92 | 45.91 | 43.33 | 24.87 | — | — | — | 31.79 | 66.14 | 23.98 | 81.26 | 29.73 | 10.39 | 64.24 | 22.05 | 52.08 | 39.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Rand1LHtraining_mode=Zero-shot, metric_type=NDCG@102026.02 | 30.8 | — | — | 24.84 | 45.34 | 42.2 | 24.42 | — | — | — | 28.66 | 63.34 | 23.28 | 80.81 | 28.49 | 9.83 | 64.66 | 21.31 | 48.64 | 38.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SingleLHtraining_mode=Zero-shot, metric_type=NDCG@102026.02 | 30.72 | — | — | 24.66 | 43.13 | 43.02 | 24.4 | — | — | — | 34.87 | 65.24 | 26.73 | 81.58 | 28.82 | 10.32 | 64.1 | 21.5 | 50.35 | 39.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SumMargLHtraining_mode=Zero-shot, metric_type=NDCG@102026.02 | 29.33 | — | — | 23.41 | 43.22 | 40.68 | 23.52 | — | — | — | 28.4 | 59.78 | 23.6 | 80.36 | 27.67 | 8.62 | 63.48 | 21.08 | 46.27 | 37.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| JointLHtraining_mode=Zero-shot, metric_type=NDCG@102026.02 | 28.65 | — | — | 25.41 | 42.89 | 41.19 | 23.53 | — | — | — | 39.52 | 62.28 | 24.58 | 65.88 | 30.49 | 10.27 | 61.1 | 21.04 | 50.6 | 37.67 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini-2.5-flash (general prompt)Setting=Zero-shot, Retriever=Contriever, Query Rewriter=Gemini-2.5-flash, Prompt Strategy=general prompt2026.06 | 28.21 | 38.34 | — | 26.58 | 16.36 | 39.16 | 10.33 | — | — | — | 31.21 | 4.58 | — | 68.99 | 23.38 | 10.55 | 22.34 | 6.21 | 51.31 | 26.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini-2.5-flash (specific prompt)Setting=Zero-shot, Retriever=Contriever, Query Rewriter=Gemini-2.5-flash, Prompt Strategy=specific Contriever prompt2026.06 | 28.13 | 37.08 | — | 26.25 | 18.7 | 39.4 | 10.13 | — | — | — | 30.72 | 3.85 | — | 64.87 | 25.7 | 10.79 | 24.77 | 6.47 | 56.7 | 27.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Contrieverrelevance judgement=w/o2022.12 | 27.3 | — | — | — | — | — | 24.5 | — | 34.8 | — | 37.9 | — | — | — | 29.2 | — | — | — | 64.9 | — | — | — | — | — | 92.6 | 90.1 | 17.2 | 56.2 | 45.3 | 42.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPRbi-encoder=true2021.12 | 21.2 | 55.2 | — | 20.8 | 88 | 59.1 | 34.2 | — | — | — | 75.1 | 30.1 | 40.3 | 47 | 34.9 | 21.9 | 84 | 39 | 72.7 | 47.7 | — | 48.3 | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContrieverSetting=Zero-shot, Retriever=Contriever2026.06 | 17.36 | 36.62 | — | 27.11 | 18.05 | 41.01 | 12.41 | — | — | — | 33.55 | 6.75 | — | 83.36 | 25.08 | 10.97 | 27.22 | 7.16 | 57.14 | 28.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GENRERetrieval Category=Generative retrieval2023.04 | 14.7 | — | — | 20 | — | — | 11.6 | — | — | — | 42.5 | — | — | — | — | 6.8 | — | — | 42.3 | 30 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Splade v2Type=Sparse Retrieval2021.12 | 12.3 | — | — | 27.7 | 93 | 82 | 62.1 | — | — | — | 97.2 | 35.4 | — | 98.7 | 57.5 | 36.4 | 95.1 | 52.4 | 92 | — | — | 64.8 | 4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SGPT-BEModel=SGPT-BE, Number of Parameters=2.7B2022.02 | 0.807 | 0.388 | 0.384 | 0.339 | 0.467 | 0.528 | 0.333 | 0.249 | 0.438 | 0.449 | 0.505 | 0.235 | 0.349 | 0.856 | 0.347 | 0.165 | 0.728 | 0.272 | 0.702 | 0.453 | 0.514 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BERMRetrieval Category=Dense2023.05 | 0.795 | 0.421 | — | 0.357 | 0.506 | 0.61 | 0.301 | — | — | — | 0.49 | 0.235 | 0.374 | 0.87 | 0.391 | 0.161 | 0.76 | 0.22 | 0.72 | — | — | — | — | — | — | — | — | — | — | — | 0.485 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SGPT-CETraining=Unsupervised, Ranking Strategy=Re-rank Top 100, Parameters=6.1B2022.02 | 0.791 | 0.29 | 0.547 | 0.347 | 0.401 | 0.699 | 0.401 | 0.323 | 0.466 | 0.48 | 0.286 | 0.234 | 0.42 | 0.794 | 0.37 | 0.196 | 0.725 | 0.161 | 0.682 | 0.462 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| COCO-DRRetrieval Category=Dense2023.05 | 0.789 | 0.419 | — | 0.355 | 0.505 | 0.616 | 0.307 | — | — | — | 0.493 | 0.238 | 0.37 | 0.867 | 0.391 | 0.16 | 0.751 | 0.211 | 0.709 | — | — | — | — | — | — | — | — | — | — | — | 0.483 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SGPT-BEModel=SGPT-BE, Number of Parameters=1.3B2022.02 | 0.785 | 0.361 | 0.347 | 0.321 | 0.43 | 0.499 | 0.3 | 0.25 | 0.424 | 0.421 | 0.497 | 0.245 | 0.32 | 0.853 | 0.315 | 0.161 | 0.682 | 0.266 | 0.683 | 0.433 | 0.495 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SGPT-CETraining=Unsupervised, Ranking Strategy=Re-rank Top 100, Parameters=2.7B2022.02 | 0.762 | 0.278 | 0.546 | 0.333 | 0.384 | 0.691 | 0.369 | 0.32 | 0.434 | 0.449 | 0.293 | 0.256 | 0.405 | 0.792 | 0.367 | 0.186 | 0.698 | 0.138 | 0.676 | 0.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25+CETraining=Unsupervised + Supervised, Ranking Strategy=Re-rank Top 1002022.02 | 0.757 | 0.413 | 0.523 | 0.35 | 0.533 | 0.707 | 0.347 | 0.338 | 0.431 | 0.475 | 0.311 | 0.271 | 0.37 | 0.825 | 0.409 | 0.166 | 0.819 | 0.253 | 0.688 | 0.476 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SGPT-BEModel=SGPT-BE, Number of Parameters=125M2022.02 | 0.738 | 0.279 | 0.272 | 0.228 | 0.297 | 0.409 | 0.211 | 0.236 | 0.319 | 0.313 | 0.455 | 0.23 | 0.249 | 0.73 | 0.227 | 0.121 | 0.605 | 0.218 | 0.569 | 0.357 | 0.42 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SGPT-CETraining=Unsupervised, Ranking Strategy=Re-rank Top 10, Parameters=2.7B2022.02 | 0.708 | 0.249 | 0.517 | 0.319 | 0.358 | 0.647 | 0.305 | 0.343 | 0.409 | 0.438 | 0.379 | 0.335 | 0.364 | 0.81 | 0.341 | 0.176 | 0.706 | 0.179 | 0.653 | 0.444 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SGPT-CETraining=Unsupervised, Ranking Strategy=Re-rank Top 10, Parameters=6.1B2022.02 | 0.705 | 0.253 | 0.518 | 0.323 | 0.366 | 0.649 | 0.313 | 0.342 | 0.418 | 0.444 | 0.376 | 0.335 | 0.367 | 0.81 | 0.34 | 0.177 | 0.723 | 0.189 | 0.657 | 0.447 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPLRetrieval Category=Dense2023.05 | 0.7 | — | — | 0.345 | 0.483 | 0.582 | 0.344 | — | — | — | 0.557 | 0.255 | 0.357 | 0.836 | 0.384 | 0.169 | 0.759 | 0.235 | 0.674 | — | — | — | — | — | — | — | — | — | — | — | 0.477 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Training=Unsupervised, Ranking Strategy=Re-rank Top 0 (Source)2022.02 | 0.688 | 0.228 | 0.488 | 0.306 | 0.326 | 0.602 | 0.254 | 0.33 | 0.405 | 0.425 | 0.472 | 0.347 | 0.326 | 0.808 | 0.32 | 0.165 | 0.649 | 0.186 | 0.611 | 0.428 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Model=BM252022.02 | 0.688 | 0.228 | 0.488 | 0.306 | 0.326 | 0.602 | 0.254 | 0.33 | 0.405 | 0.425 | 0.472 | 0.347 | 0.326 | 0.808 | 0.32 | 0.165 | 0.649 | 0.186 | 0.611 | 0.428 | 0.477 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ColBERTRetrieval Category=Late-Inter.2023.05 | 0.677 | 0.401 | — | 0.305 | 0.524 | 0.593 | 0.317 | — | — | — | 0.233 | 0.202 | 0.35 | 0.854 | 0.392 | 0.145 | 0.771 | 0.184 | 0.671 | — | — | — | — | — | — | — | — | — | — | — | 0.444 | — | — | — | — | — | — | — | — | — | — | — | — | |
| MODIRRetrieval Category=Dense2023.05 | 0.676 | 0.388 | — | 0.244 | 0.442 | 0.462 | 0.296 | — | — | — | 0.418 | 0.315 | 0.297 | 0.856 | 0.284 | 0.124 | 0.68 | 0.206 | 0.502 | — | — | — | — | — | — | — | — | — | — | — | 0.414 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Retrieval Category=Sparse2023.05 | 0.656 | 0.228 | — | 0.325 | 0.329 | 0.603 | 0.236 | — | — | — | 0.414 | 0.367 | 0.299 | 0.789 | 0.313 | 0.158 | 0.753 | 0.213 | 0.665 | — | — | — | — | — | — | — | — | — | — | — | 0.437 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OpenAI SearchTraining=Unsupervised, Ranking Strategy=Re-rank Top 10, Model Variant=Davinci2022.02 | 0.627 | — | — | 0.358 | — | — | — | 0.313 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GenQRetrieval Category=Dense2023.05 | 0.619 | 0.408 | — | 0.319 | 0.358 | 0.534 | 0.308 | — | — | — | 0.493 | 0.182 | 0.347 | 0.83 | 0.328 | 0.143 | 0.669 | 0.175 | 0.644 | — | — | — | — | — | — | — | — | — | — | — | 0.425 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OpenAI SearchTraining=Unsupervised, Ranking Strategy=Re-rank Top 10, Model Variant=Ada2022.02 | 0.616 | — | — | 0.336 | — | — | 0.32 | 0.313 | — | — | 0.166 | 0.332 | 0.328 | 0.786 | — | 0.161 | — | — | 0.727 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |