Semantic Relatedness on BEIR Semantic Relatedness Tasks (test)
47.9ArguAna ScoreSPLADEV2
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SPLADEV2Distillation=true, Zero-shot=true2021.12 | 47.9 | 23.5 | 78.6 | 83.8 | 15.8 | 69.3 | |
| ColBERTv2Distillation=true, Zero-shot=true2021.12 | 46.3 | 17.6 | 78.5 | 85.2 | 15.4 | 69.3 | |
| RocketQAv2Distillation=true, Zero-shot=true2021.12 | 45.1 | 18 | 67.6 | 74.9 | 13.1 | 56.8 | |
| RocketQAv22026.03 | 45.1 | 18 | 67.6 | 74.9 | 13.1 | 56.8 | |
| ColBERT-Att2026.03 | 44.3 | 17.6 | 77.4 | 85.4 | 14.5 | 66.2 | |
| TAS-BDistillation=true, Zero-shot=true2021.12 | 42.7 | 22.8 | 70 | 83.5 | 14.9 | 64.3 | |
| TAS-B2026.03 | 42.7 | 22.8 | 70 | 83.5 | 14.9 | 64.3 | |
| ColBERTv2_PLAID2026.03 | 42.06 | 16.7 | 76.53 | 84.9 | 14.3 | 67.1 | |
| MODIRDistillation=false, Zero-shot=true2021.12 | 41.8 | 20.6 | 68 | 85.6 | 12.4 | 50.2 | |
| MoDIR2026.03 | 41.8 | 20.6 | 68 | 85.6 | 12.4 | 50.2 | |
| ANCEDistillation=false, Zero-shot=true2021.12 | 41.5 | 19.8 | 66.9 | 85.2 | 12.2 | 50.7 | |
| ANCE2026.03 | 41.5 | 19.8 | 66.9 | 85.2 | 12.2 | 50.7 | |
| DPR-MDistillation=false, Zero-shot=true2021.12 | 41.4 | 17.6 | 58.9 | 84.2 | 10.8 | 47.8 | |
| DPR-M2026.03 | 41.4 | 17.6 | 58.9 | 84.2 | 10.8 | 47.8 | |
| ColBERTDistillation=false, Zero-shot=true2021.12 | 23.3 | 18.4 | 77.1 | 85.4 | 14.5 | 67.1 | |
| ColBERT2026.03 | 23.3 | 18.4 | 77.1 | 85.4 | 14.5 | 67.1 |