Passage Ranking on TREC DL 2019 (test)
73.4NDCG@10ADAM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ADAMTeacher=R2anker, PLM=BERTbase, KD=true2022.12 | 73.4 | 49.8 | |
| Unifier (lexicon)Retrieval Type=Sparse, PLM=coConbase, KD=true2022.12 | 73.3 | — | |
| PRODRetrieval Type=Dense, PLM=ERNIE-2.0-BASE, KD=true2022.12 | 73.3 | 48.4 | |
| CL-DRDRetrieval Type=Dense, PLM=DistilBERT, KD=true2022.12 | 72.5 | 45.3 | |
| ADAMTeacher=RocketQAV2, PLM=BERTbase, KD=true2022.12 | 72.1 | 50.3 | |
| ColBERT v2Retrieval Type=Dense, PLM=BERTbase, KD=true2022.12 | 72 | — | |
| TAS-BalancedRetrieval Type=Dense, PLM=BERTbase, KD=true2022.12 | 71.2 | — | |
| Unifier (dense)Retrieval Type=Dense, PLM=coConbase, KD=true2022.12 | 71.1 | — | |
| ColBERT-CQRetrieval=BM25, Task=Re-ranking, Quantization=Contextual2022.03 | 70.4 | — | |
| COIL-fullRetrieval Type=Sparse, PLM=BERTbase2022.12 | 70.4 | — | |
| uniCOILRetrieval=Direct2022.03 | 70.3 | — | |
| ColBERTRetrieval=BM25, Task=Re-ranking2022.03 | 70.1 | — | |
| bi-SimLMRetrieval Type=Dense, PLM=BERTbase2022.12 | 69.8 | — | |
| ColBERT-CQRetrieval=uniCOIL, Task=Re-ranking, Quantization=Contextual2022.03 | 69.6 | — | |
| DeepImpactRetrieval=Direct2022.03 | 69.5 | — | |
| ColBERTRetrieval=uniCOIL, Task=Re-ranking2022.03 | 69.2 | — | |
| ColBERT-PQRetrieval=BM25, Task=Re-ranking, Quantization=Product2022.03 | 68.4 | — | |
| SPLADE-maxRetrieval Type=Sparse, PLM=BERTbase, KD=true2022.12 | 68.4 | — | |
| ADORE+STARRetrieval Type=Dense, PLM=ROBERTabase2022.12 | 68.3 | — | |
| BERT-baseRetrieval=BM25, Task=Re-ranking2022.03 | 68.2 | — | |
| BECRRetrieval=BM25, Task=Re-ranking2022.03 | 68.2 | — | |
| ColBERT-RQRetrieval=BM25, Task=Re-ranking, Quantization=Residual2022.03 | 67.9 | — | |
| JPQRetrieval=Direct2022.03 | 67.7 | — | |
| TILDEv2Retrieval=BM25, Task=Re-ranking2022.03 | 67.6 | — | |
| ColBERT-OPQRetrieval=BM25, Task=Re-ranking, Quantization=Optimized Product2022.03 | 67.5 | — | |
| ColBERTRetrieval Type=Dense, PLM=BERTbase2022.12 | 67 | — | |
| ColBERT-LSQRetrieval=BM25, Task=Re-ranking, Quantization=Local Search2022.03 | 66.4 | — | |
| ANCE (single)Retrieval Type=Dense, PLM=ROBERTabase2022.12 | 65.4 | 44.5 | |
| docT5queryRetrieval=Direct2022.03 | 59 | — | |
| DeepCTRetrieval=Direct2022.03 | 57.2 | — | |
| DeepCTRetrieval Type=Sparse, PLM=BERTbase2022.12 | 55.1 | — | |
| BM25 (anserini)Retrieval Type=Sparse2022.12 | 50.6 | — | |
| BM25Retrieval=Direct2022.03 | 42.5 | — |