# Ad-hoc Document Ranking on WebTrack 2012-14 Source: [Ad-hoc Document Ranking on WebTrack 2012-14]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:11:10.075Z Evaluation of Ad-hoc Document Ranking performance using nDCG@20 and ERR@20 on the WebTrack 2012-14 dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Ad-hoc Document Ranking | | Dataset (including any stated split) | WebTrack 2012-14 | | Metric | nDCG@20 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [nDCG@20](): Higher is better; unit: PERCENT. - [ERR@20](): Higher is better; unit: PERCENT. ## Recorded results | Method | nDCG@20 | Result date | Report paper | | --- | --- | --- | --- | | CEDR-DRMM | 34.97 | Not recorded | 68fa66341e209131cea0ebe5 | | CEDR-KNRM | 34.69 | Not recorded | 68fa66341e209131cea0ebe5 | | CEDR-PACRR | 33.3 | Not recorded | 68fa66341e209131cea0ebe5 | | KNRM | 32.87 | Not recorded | 68fa66341e209131cea0ebe5 | | PACRR | 30.8 | Not recorded | 68fa66341e209131cea0ebe5 | | Vanilla BERT | 28.95 | Not recorded | 68fa66341e209131cea0ebe5 | | TREC-Best | 28.55 | Not recorded | 68fa66341e209131cea0ebe5 | | DRMM | 25.98 | Not recorded | 68fa66341e209131cea0ebe5 | | ConvKNRM | 25.47 | Not recorded | 68fa66341e209131cea0ebe5 | | KNRM | 25.25 | Not recorded | 68fa66341e209131cea0ebe5 | | DRMM | 24.59 | Not recorded | 68fa66341e209131cea0ebe5 | | KNRM | 24.48 | Not recorded | 68fa66341e209131cea0ebe5 | | PACRR | 23.24 | Not recorded | 68fa66341e209131cea0ebe5 | | DRMM | 22.71 | Not recorded | 68fa66341e209131cea0ebe5 | | KNRM | 22.27 | Not recorded | 68fa66341e209131cea0ebe5 | | DRMM | 22.15 | Not recorded | 68fa66341e209131cea0ebe5 | | PACRR | 21.01 | Not recorded | 68fa66341e209131cea0ebe5 | | BM25 | 19.7 | Not recorded | 68fa66341e209131cea0ebe5 | ### CEDR-DRMM nDCG@20: 34.97. Result ID: 698cdf028b517eb4331d5207. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input Representation":"BERT (fine-tuned)"}. This record does not assert independent reproduction. ### CEDR-KNRM nDCG@20: 34.69. Result ID: 698cdf028b517eb4331d5202. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input Representation":"BERT (fine-tuned)"}. This record does not assert independent reproduction. ### CEDR-PACRR nDCG@20: 33.3. Result ID: 698cdf028b517eb4331d51fd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input Representation":"BERT (fine-tuned)"}. This record does not assert independent reproduction. ### KNRM nDCG@20: 32.87. Result ID: 698cdf028b517eb4331d5201. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"BERT (fine-tuned)"}. This record does not assert independent reproduction. ### PACRR nDCG@20: 30.8. Result ID: 698cdf028b517eb4331d51fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"BERT (fine-tuned)"}. This record does not assert independent reproduction. ### Vanilla BERT nDCG@20: 28.95. Result ID: 698cdf028b517eb4331d51f9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input Representation":"BERT (fine-tuned)"}. This record does not assert independent reproduction. ### TREC-Best nDCG@20: 28.55. Result ID: 698cdf028b517eb4331d51f7. [Reporting paper]() Recorded evaluation configuration: {"Input Representation":"n/a"}. This record does not assert independent reproduction. ### DRMM nDCG@20: 25.98. Result ID: 698cdf028b517eb4331d5206. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"BERT (fine-tuned)"}. This record does not assert independent reproduction. ### ConvKNRM nDCG@20: 25.47. Result ID: 698cdf028b517eb4331d51f8. [Reporting paper]() Recorded evaluation configuration: {"Input Representation":"GloVe"}. This record does not assert independent reproduction. ### KNRM nDCG@20: 25.25. Result ID: 698cdf028b517eb4331d5200. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"BERT"}. This record does not assert independent reproduction. ### DRMM nDCG@20: 24.59. Result ID: 698cdf028b517eb4331d5205. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"BERT"}. This record does not assert independent reproduction. ### KNRM nDCG@20: 24.48. Result ID: 698cdf028b517eb4331d51fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"GloVe"}. This record does not assert independent reproduction. ### PACRR nDCG@20: 23.24. Result ID: 698cdf028b517eb4331d51fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"ELMo"}. This record does not assert independent reproduction. ### DRMM nDCG@20: 22.71. Result ID: 698cdf028b517eb4331d5204. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"ELMo"}. This record does not assert independent reproduction. ### KNRM nDCG@20: 22.27. Result ID: 698cdf028b517eb4331d51ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"ELMo"}. This record does not assert independent reproduction. ### DRMM nDCG@20: 22.15. Result ID: 698cdf028b517eb4331d5203. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"GloVe"}. This record does not assert independent reproduction. ### PACRR nDCG@20: 21.01. Result ID: 698cdf028b517eb4331d51fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Representation":"GloVe"}. This record does not assert independent reproduction. ### BM25 nDCG@20: 19.7. Result ID: 698cdf028b517eb4331d51f6. [Reporting paper]() Recorded evaluation configuration: {"Input Representation":"n/a"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.