# Passage Ranking on TREC DL 2019 (R@10)

Source: [Passage Ranking on TREC DL 2019 (R@10)](<https://www.sota2.com/research/sota/passage-ranking-on-trec-dl-2019-r-at-10>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:59:39.131Z

Evaluation of Passage Ranking performance on the TREC DL 2019 dataset, measured using the R@10 metric.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Passage Ranking |
| Dataset (including any stated split) | TREC DL 2019 |
| Metric | R@10 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 28 of 28 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R@10](<https://www.sota2.com/research/sota/passage-ranking-on-trec-dl-2019-r-at-10.md?metric=R%4010>): Higher is better; unit: PERCENT.

## Recorded results

| Method | R@10 | Result date | Report paper |
| --- | --- | --- | --- |
| monot5-3B | 100 | Not recorded | 68fa734f1e209131cea5bb8d |
| TART | 100 | Not recorded | 68fa734f1e209131cea5bb8d |
| monot5-base | 96.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| monoBERT | 96.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 96.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 96.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 96.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 96.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank | 95.34 | Not recorded | 68fa734f1e209131cea5bb8d |
| BM25 | 93.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| Likert | 93.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 93.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| Likert | 93.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| Likert | 93.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 90 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-RankGPT | 90 | Not recorded | 68fa734f1e209131cea5bb8d |
| InPars | 86.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 86.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank | 86.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank-w/o-casc. | 86.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank | 86.66 | Not recorded | 68fa734f1e209131cea5bb8d |
| InPars | 83.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank-w/o-casc. | 83.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| InPars | 83.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 83.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-UPR | 83.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-UPR | 63.33 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-UPR | 60 | Not recorded | 68fa734f1e209131cea5bb8d |

### monot5-3B

R@10: 100. Result ID: 6992b8903a6c3148491104ba.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67341e209131cea14b55.md>)

[Implementation](<http://anserini.io/>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-3B"}. This record does not assert independent reproduction.

### TART

R@10: 100. Result ID: 6992b8903a6c3148491104bc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e441e209131cea3edae.md>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-XL"}. This record does not assert independent reproduction.

### monot5-base

R@10: 96.66. Result ID: 6992b8903a6c3148491104b9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67341e209131cea14b55.md>)

[Implementation](<http://anserini.io/>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-base"}. This record does not assert independent reproduction.

### monoBERT

R@10: 96.66. Result ID: 6992b8903a6c3148491104bb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15dd5.md>)

[Implementation](<https://github.com/nyu-dl/dl4marco-bert>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"BERT"}. This record does not assert independent reproduction.

### Binary

R@10: 96.66. Result ID: 6992b8903a6c3148491104bf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"GPT-3.5"}. This record does not assert independent reproduction.

### B-PRP

R@10: 96.66. Result ID: 6992b8903a6c3148491104c2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-PRP

R@10: 96.66. Result ID: 6992b8903a6c3148491104ca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-PRP

R@10: 96.66. Result ID: 6992b8903a6c3148491104d1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank

R@10: 95.34. Result ID: 6992b8903a6c3148491104c5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction.

### BM25

R@10: 93.33. Result ID: 6992b8903a6c3148491104b8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

Recorded evaluation configuration: {"Supervision":"None"}. This record does not assert independent reproduction.

### Likert

R@10: 93.33. Result ID: 6992b8903a6c3148491104c0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c01e209131cea58645.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-PRP

R@10: 93.33. Result ID: 6992b8903a6c3148491104c3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Pair","LLM":"GPT-3.5"}. This record does not assert independent reproduction.

### Likert

R@10: 93.33. Result ID: 6992b8903a6c3148491104c8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c01e209131cea58645.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### Likert

R@10: 93.33. Result ID: 6992b8903a6c3148491104cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c01e209131cea58645.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### Binary

R@10: 90. Result ID: 6992b8903a6c3148491104be.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-RankGPT

R@10: 90. Result ID: 6992b8903a6c3148491104c4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76721e209131cea6d0b1.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"List","LLM":"GPT-3.5"}. This record does not assert independent reproduction.

### InPars

R@10: 86.66. Result ID: 6992b8903a6c3148491104bd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc81e209131cea304ad.md>)

Recorded evaluation configuration: {"Budget":"B1","LLM":"T5-large"}. This record does not assert independent reproduction.

### Binary

R@10: 86.66. Result ID: 6992b8903a6c3148491104c7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank

R@10: 86.66. Result ID: 6992b8903a6c3148491104cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Hybr","LLM":"T5-XL+L"}. This record does not assert independent reproduction.

### EcoRank-w/o-casc.

R@10: 86.66. Result ID: 6992b8903a6c3148491104d2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank

R@10: 86.66. Result ID: 6992b8903a6c3148491104d3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Hybr","LLM":"T5-XL+L"}. This record does not assert independent reproduction.

### InPars

R@10: 83.33. Result ID: 6992b8903a6c3148491104c6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc81e209131cea304ad.md>)

Recorded evaluation configuration: {"Budget":"B2","LLM":"T5-large"}. This record does not assert independent reproduction.

### EcoRank-w/o-casc.

R@10: 83.33. Result ID: 6992b8903a6c3148491104cb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction.

### InPars

R@10: 83.33. Result ID: 6992b8903a6c3148491104cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc81e209131cea304ad.md>)

Recorded evaluation configuration: {"Budget":"B3","LLM":"T5-large"}. This record does not assert independent reproduction.

### Binary

R@10: 83.33. Result ID: 6992b8903a6c3148491104ce.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-UPR

R@10: 83.33. Result ID: 6992b8903a6c3148491104d0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef11e209131cea430f9.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-UPR

R@10: 63.33. Result ID: 6992b8903a6c3148491104c1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef11e209131cea430f9.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-UPR

R@10: 60. Result ID: 6992b8903a6c3148491104c9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef11e209131cea430f9.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
