Passage Retrieval on MS MARCO Passage Ranking 7k queries (dev)
39.7MRR@10ColBERTv2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ColBERTv2Distillation or Special Pretraining=true, embedding compression=2 bits per dimension2021.12 | 39.7 | 86.8 | 98.4 | |
| RocketQAv2Distillation or Special Pretraining=true2021.12 | 38.8 | 86.2 | 98.1 | |
| coCondenserDistillation or Special Pretraining=true2021.12 | 38.2 | — | 98.4 | |
| PAIRDistillation or Special Pretraining=true2021.12 | 37.9 | 86.4 | 98.2 | |
| SPLADEv2Distillation or Special Pretraining=true2021.12 | 36.8 | — | 97.9 | |
| ColBERTDistillation or Special Pretraining=false2021.12 | 36 | 82.9 | 96.8 | |
| TAS-BDistillation or Special Pretraining=true2021.12 | 34.7 | — | 97.8 | |
| LTRDistillation or Special Pretraining=false2021.12 | 34.1 | — | 96.2 | |
| ANCEDistillation or Special Pretraining=false2021.12 | 33 | — | 95.9 | |
| DPRDistillation or Special Pretraining=false2021.12 | 31.1 | — | 95.2 | |
| RepBERTDistillation or Special Pretraining=false2021.12 | 30.4 | — | 94.3 |