Text Ranking on BEIR Out-of-Domain (Aggregate)
56.2Average Score (BEIR OOD)TSARankLLM
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TSARankLLMLLM=BLOOM, Size=3B2023.11 | 56.2 | 55.6 | 27.7 | 50 | 83.7 | 44.9 | 76.4 | 39.4 | 58.7 | 82.9 | 19.2 | 78 | 83.3 | 30.2 | |
| MonoT5LLM=T5, Size=3B2023.11 | 54.6 | 28.8 | 28 | 47.8 | 85 | 51.4 | 75.9 | 38.4 | 63.3 | 84.1 | 19.7 | 77.7 | 79.5 | 30 | |
| TSARankLLMLLM=BLOOM, Size=1B2023.11 | 54.5 | 55.1 | 23.6 | 45.4 | 82.3 | 42 | 75.4 | 37.9 | 57.6 | 82.3 | 18.7 | 76.3 | 81.7 | 29.7 | |
| RankT5LLM=T5, Size=770M2023.11 | 53.7 | 33 | 21.5 | 44.2 | 83.2 | 44.5 | 71 | 38.1 | 61.4 | 83.1 | 18.1 | 75 | 80.7 | 44 | |
| TSARankLLMLLM=BLOOM, Size=560M2023.11 | 53.7 | 53.3 | 22.3 | 44.5 | 83.6 | 40 | 75.6 | 37.3 | 56.1 | 82.9 | 18.1 | 77.1 | 78.9 | 28.2 | |
| MonoT5LLM=T5, Size=770M2023.11 | 53.1 | 30.2 | 25.9 | 43.5 | 82.8 | 44.6 | 73.6 | 38.4 | 60.8 | 85.4 | 19.1 | 75.5 | 82.3 | 28.5 | |
| ModernBERT-VTTeachers=12026.04 | 52.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SPLADE-v3Teachers=52026.04 | 52 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Co-SelfDistilTeachers=12026.04 | 51.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ESPLADETeachers=12026.04 | 51.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Co-EnsembleDistilTeachers=12026.04 | 50.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BERT (Splade)Teachers=12026.04 | 50.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MonoBERTLLM=BERT, Size=340M2023.11 | 50.5 | 51.5 | 24.9 | 43.5 | 81.3 | 36.8 | 73.5 | 36.9 | 56.8 | 71.5 | 15.7 | 72 | 65 | 27.7 | |
| BERT (Splade) + further MLMTeachers=12026.04 | 50.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ColBERTv22026.04 | 50 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MonoT5LLM=T5, Size=220M2023.11 | 49.3 | 13.2 | 24.5 | 42 | 80.2 | 41.4 | 69.5 | 35.7 | 56.7 | 82.3 | 16.5 | 73.6 | 77.8 | 27.7 | |
| BM25LLM=NA, Size=NA2023.11 | 48.3 | 39.7 | 16.5 | 31.8 | 65.1 | 23.6 | 63.3 | 33.8 | 30.6 | 78.9 | 14.9 | 67.9 | 59.5 | 44.2 | |
| ModernBERT (Splade)Teachers=12026.04 | 47.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ModernBERT (Splade) + further MLMTeachers=12026.04 | 47.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ModernBERT (Splade) + lowercase inputTeachers=12026.04 | 46.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ModernBERT (dense)2026.04 | 44.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| uniCOIL2026.04 | 44.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM252026.04 | 43.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BERT (dense)2026.04 | 42.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CoCondenser2026.04 | 42 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeepImpact2026.04 | 41.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPR2026.04 | 37.5 | — | — | — | — | — | — | — | — | — | — | — | — | — |