Ad-hoc Document Ranking on WebTrack 2012-14
34.97nDCG@20CEDR-DRMM
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CEDR-DRMMInput Representation=BERT (fine-tuned)2019.04 | 34.97 | 26.21 | |
| CEDR-KNRMInput Representation=BERT (fine-tuned)2019.04 | 34.69 | 26.56 | |
| CEDR-PACRRInput Representation=BERT (fine-tuned)2019.04 | 33.3 | 23.34 | |
| KNRMInput Representation=BERT (fine-tuned)2019.04 | 32.87 | 25.57 | |
| PACRRInput Representation=BERT (fine-tuned)2019.04 | 30.8 | 18.85 | |
| Vanilla BERTInput Representation=BERT (fine-tuned)2019.04 | 28.95 | 22.18 | |
| TREC-BestInput Representation=n/a2019.04 | 28.55 | 25.3 | |
| DRMMInput Representation=BERT (fine-tuned)2019.04 | 25.98 | 18.56 | |
| ConvKNRMInput Representation=GloVe2019.04 | 25.47 | 18.33 | |
| KNRMInput Representation=BERT2019.04 | 25.25 | 19.44 | |
| DRMMInput Representation=BERT2019.04 | 24.59 | 19.77 | |
| KNRMInput Representation=GloVe2019.04 | 24.48 | 17.55 | |
| PACRRInput Representation=ELMo2019.04 | 23.24 | 18.17 | |
| DRMMInput Representation=ELMo2019.04 | 22.71 | 17.62 | |
| KNRMInput Representation=ELMo2019.04 | 22.27 | 16.89 | |
| DRMMInput Representation=GloVe2019.04 | 22.15 | 16.03 | |
| PACRRInput Representation=GloVe2019.04 | 21.01 | 16.08 | |
| BM25Input Representation=n/a2019.04 | 19.7 | 14.72 |