# Text Ranking on BEIR Out-of-Domain (Aggregate) Source: [Text Ranking on BEIR Out-of-Domain (Aggregate)]() Collection index: [llms.txt]() Data updated: 2026-07-02T07:18:52.799Z Evaluation of Text Ranking performance, reporting the average score across the standard set of BEIR out-of-domain datasets (including Arguana, Climate, DBPedia, FEVER, etc.). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text Ranking | | Dataset (including any stated split) | BEIR out-of-domain | | Metric | Average Score (BEIR OOD) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 27 of 27 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Average Score (BEIR OOD)](): Higher is better; unit: PERCENT. - [Arguana Score](): Higher is better; unit: PERCENT. - [Climate Score](): Higher is better; unit: PERCENT. - [DBPedia Score](): Higher is better; unit: PERCENT. - [FEVER Score](): Higher is better; unit: PERCENT. - [FIQA Score](): Higher is better; unit: PERCENT. - [HotpotQA Score](): Higher is better; unit: PERCENT. - [NFCorpus Score](): Higher is better; unit: PERCENT. - [NQ Score](): Higher is better; unit: PERCENT. - [Quora Score](): Higher is better; unit: PERCENT. - [SCIDOCS Score](): Higher is better; unit: PERCENT. - [SciFact Score](): Higher is better; unit: PERCENT. - [COVID Score](): Higher is better; unit: PERCENT. - [Touche Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Average Score (BEIR OOD) | Result date | Report paper | | --- | --- | --- | --- | | TSARankLLM | 56.2 | Not recorded | 68fa73651e209131cea5c2ea | | MonoT5 | 54.6 | Not recorded | 68fa73651e209131cea5c2ea | | TSARankLLM | 54.5 | Not recorded | 68fa73651e209131cea5c2ea | | RankT5 | 53.7 | Not recorded | 68fa73651e209131cea5c2ea | | TSARankLLM | 53.7 | Not recorded | 68fa73651e209131cea5c2ea | | MonoT5 | 53.1 | Not recorded | 68fa73651e209131cea5c2ea | | ModernBERT-VT | 52.4 | Not recorded | 6a45f05edc71372d77959f8e | | SPLADE-v3 | 52 | Not recorded | 6a45f05edc71372d77959f8e | | Co-SelfDistil | 51.2 | Not recorded | 6a45f05edc71372d77959f8e | | ESPLADE | 51.2 | Not recorded | 6a45f05edc71372d77959f8e | | Co-EnsembleDistil | 50.9 | Not recorded | 6a45f05edc71372d77959f8e | | BERT (Splade) | 50.6 | Not recorded | 6a45f05edc71372d77959f8e | | MonoBERT | 50.5 | Not recorded | 68fa73651e209131cea5c2ea | | BERT (Splade) + further MLM | 50.5 | Not recorded | 6a45f05edc71372d77959f8e | | ColBERTv2 | 50 | Not recorded | 6a45f05edc71372d77959f8e | | MonoT5 | 49.3 | Not recorded | 68fa73651e209131cea5c2ea | | BM25 | 48.3 | Not recorded | 68fa73651e209131cea5c2ea | | ModernBERT (Splade) | 47.7 | Not recorded | 6a45f05edc71372d77959f8e | | ModernBERT (Splade) + further MLM | 47.5 | Not recorded | 6a45f05edc71372d77959f8e | | ModernBERT (Splade) + lowercase input | 46.8 | Not recorded | 6a45f05edc71372d77959f8e | | ModernBERT (dense) | 44.2 | Not recorded | 6a45f05edc71372d77959f8e | | uniCOIL | 44.1 | Not recorded | 6a45f05edc71372d77959f8e | | BM25 | 43.7 | Not recorded | 6a45f05edc71372d77959f8e | | BERT (dense) | 42.1 | Not recorded | 6a45f05edc71372d77959f8e | | CoCondenser | 42 | Not recorded | 6a45f05edc71372d77959f8e | | DeepImpact | 41.5 | Not recorded | 6a45f05edc71372d77959f8e | | DPR | 37.5 | Not recorded | 6a45f05edc71372d77959f8e | ### TSARankLLM Average Score (BEIR OOD): 56.2. Result ID: 6992d8ba3a6c31484911e65e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"BLOOM","Size":"3B"}. This record does not assert independent reproduction. ### MonoT5 Average Score (BEIR OOD): 54.6. Result ID: 6992d8ba3a6c31484911e65a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"T5","Size":"3B"}. This record does not assert independent reproduction. ### TSARankLLM Average Score (BEIR OOD): 54.5. Result ID: 6992d8ba3a6c31484911e65d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"BLOOM","Size":"1B"}. This record does not assert independent reproduction. ### RankT5 Average Score (BEIR OOD): 53.7. Result ID: 6992d8ba3a6c31484911e65b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"T5","Size":"770M"}. This record does not assert independent reproduction. ### TSARankLLM Average Score (BEIR OOD): 53.7. Result ID: 6992d8ba3a6c31484911e65c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"BLOOM","Size":"560M"}. This record does not assert independent reproduction. ### MonoT5 Average Score (BEIR OOD): 53.1. Result ID: 6992d8ba3a6c31484911e659. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"T5","Size":"770M"}. This record does not assert independent reproduction. ### ModernBERT-VT Average Score (BEIR OOD): 52.4. Result ID: 6a4610bf60b88bb33983e8b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### SPLADE-v3 Average Score (BEIR OOD): 52. Result ID: 6a4610bf60b88bb33983e8b1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Teachers":"5"}. This record does not assert independent reproduction. ### Co-SelfDistil Average Score (BEIR OOD): 51.2. Result ID: 6a4610bf60b88bb33983e8ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### ESPLADE Average Score (BEIR OOD): 51.2. Result ID: 6a4610bf60b88bb33983e8b0. [Reporting paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### Co-EnsembleDistil Average Score (BEIR OOD): 50.9. Result ID: 6a4610bf60b88bb33983e8af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### BERT (Splade) Average Score (BEIR OOD): 50.6. Result ID: 6a4610bf60b88bb33983e8b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### MonoBERT Average Score (BEIR OOD): 50.5. Result ID: 6992d8ba3a6c31484911e657. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM":"BERT","Size":"340M"}. This record does not assert independent reproduction. ### BERT (Splade) + further MLM Average Score (BEIR OOD): 50.5. Result ID: 6a4610bf60b88bb33983e8b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### ColBERTv2 Average Score (BEIR OOD): 50. Result ID: 6a4610bf60b88bb33983e8a9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MonoT5 Average Score (BEIR OOD): 49.3. Result ID: 6992d8ba3a6c31484911e658. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM":"T5","Size":"220M"}. This record does not assert independent reproduction. ### BM25 Average Score (BEIR OOD): 48.3. Result ID: 6992d8ba3a6c31484911e656. [Reporting paper]() Recorded evaluation configuration: {"LLM":"NA","Size":"NA"}. This record does not assert independent reproduction. ### ModernBERT (Splade) Average Score (BEIR OOD): 47.7. Result ID: 6a4610bf60b88bb33983e8b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### ModernBERT (Splade) + further MLM Average Score (BEIR OOD): 47.5. Result ID: 6a4610bf60b88bb33983e8b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### ModernBERT (Splade) + lowercase input Average Score (BEIR OOD): 46.8. Result ID: 6a4610bf60b88bb33983e8b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teachers":"1"}. This record does not assert independent reproduction. ### ModernBERT (dense) Average Score (BEIR OOD): 44.2. Result ID: 6a4610bf60b88bb33983e8ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### uniCOIL Average Score (BEIR OOD): 44.1. Result ID: 6a4610bf60b88bb33983e8aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### BM25 Average Score (BEIR OOD): 43.7. Result ID: 6a4610bf60b88bb33983e8a6. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### BERT (dense) Average Score (BEIR OOD): 42.1. Result ID: 6a4610bf60b88bb33983e8ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CoCondenser Average Score (BEIR OOD): 42. Result ID: 6a4610bf60b88bb33983e8a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DeepImpact Average Score (BEIR OOD): 41.5. Result ID: 6a4610bf60b88bb33983e8ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DPR Average Score (BEIR OOD): 37.5. Result ID: 6a4610bf60b88bb33983e8a7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.