# Passage Ranking on TREC DL 2020 (R@10)

Source: [Passage Ranking on TREC DL 2020 (R@10)](<https://www.sota2.com/research/sota/passage-ranking-on-trec-dl-2020-r-at-10>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:59:39.149Z

Evaluation of Passage Ranking performance on the TREC DL 2020 dataset, measured using Rank at 10 (R@10).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Passage Ranking |
| Dataset (including any stated split) | TREC DL 2020 |
| Metric | R@10 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 28 of 28 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R@10](<https://www.sota2.com/research/sota/passage-ranking-on-trec-dl-2020-r-at-10.md?metric=R%4010>): Higher is better; unit: PERCENT.

## Recorded results

| Method | R@10 | Result date | Report paper |
| --- | --- | --- | --- |
| monot5-base | 100 | Not recorded | 68fa734f1e209131cea5bb8d |
| monot5-3B | 100 | Not recorded | 68fa734f1e209131cea5bb8d |
| monoBERT | 100 | Not recorded | 68fa734f1e209131cea5bb8d |
| InPars | 100 | Not recorded | 68fa734f1e209131cea5bb8d |
| TART | 97.72 | Not recorded | 68fa734f1e209131cea5bb8d |
| InPars | 97.72 | Not recorded | 68fa734f1e209131cea5bb8d |
| InPars | 97.72 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank-w/o-casc. | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 95.45 | Not recorded | 68fa734f1e209131cea5bb8d |
| Likert | 93.18 | Not recorded | 68fa734f1e209131cea5bb8d |
| Likert | 93.18 | Not recorded | 68fa734f1e209131cea5bb8d |
| BM25 | 92.15 | Not recorded | 68fa734f1e209131cea5bb8d |
| Binary | 90.9 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-RankGPT | 90.9 | Not recorded | 68fa734f1e209131cea5bb8d |
| Likert | 90.9 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank-w/o-casc. | 90.9 | Not recorded | 68fa734f1e209131cea5bb8d |
| EcoRank | 90.9 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-PRP | 86.36 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-UPR | 77.27 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-UPR | 61.36 | Not recorded | 68fa734f1e209131cea5bb8d |
| B-UPR | 59.09 | Not recorded | 68fa734f1e209131cea5bb8d |

### monot5-base

R@10: 100. Result ID: 6992b8903a6c3148491104d5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67341e209131cea14b55.md>)

[Implementation](<http://anserini.io/>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-base"}. This record does not assert independent reproduction.

### monot5-3B

R@10: 100. Result ID: 6992b8903a6c3148491104d6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67341e209131cea14b55.md>)

[Implementation](<http://anserini.io/>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-3B"}. This record does not assert independent reproduction.

### monoBERT

R@10: 100. Result ID: 6992b8903a6c3148491104d7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15dd5.md>)

[Implementation](<https://github.com/nyu-dl/dl4marco-bert>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"BERT"}. This record does not assert independent reproduction.

### InPars

R@10: 100. Result ID: 6992b8903a6c3148491104e2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc81e209131cea304ad.md>)

Recorded evaluation configuration: {"Budget":"B2","LLM":"T5-large"}. This record does not assert independent reproduction.

### TART

R@10: 97.72. Result ID: 6992b8903a6c3148491104d8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e441e209131cea3edae.md>)

Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-XL"}. This record does not assert independent reproduction.

### InPars

R@10: 97.72. Result ID: 6992b8903a6c3148491104d9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc81e209131cea304ad.md>)

Recorded evaluation configuration: {"Budget":"B1","LLM":"T5-large"}. This record does not assert independent reproduction.

### InPars

R@10: 97.72. Result ID: 6992b8903a6c3148491104e9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc81e209131cea304ad.md>)

Recorded evaluation configuration: {"Budget":"B3","LLM":"T5-large"}. This record does not assert independent reproduction.

### Binary

R@10: 95.45. Result ID: 6992b8903a6c3148491104da.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-PRP

R@10: 95.45. Result ID: 6992b8903a6c3148491104de.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank

R@10: 95.45. Result ID: 6992b8903a6c3148491104e1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction.

### Binary

R@10: 95.45. Result ID: 6992b8903a6c3148491104e3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-PRP

R@10: 95.45. Result ID: 6992b8903a6c3148491104e6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank-w/o-casc.

R@10: 95.45. Result ID: 6992b8903a6c3148491104e7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank

R@10: 95.45. Result ID: 6992b8903a6c3148491104e8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Hybr","LLM":"T5-XL+L"}. This record does not assert independent reproduction.

### Binary

R@10: 95.45. Result ID: 6992b8903a6c3148491104ea.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-PRP

R@10: 95.45. Result ID: 6992b8903a6c3148491104ed.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction.

### Likert

R@10: 93.18. Result ID: 6992b8903a6c3148491104dc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c01e209131cea58645.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### Likert

R@10: 93.18. Result ID: 6992b8903a6c3148491104e4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c01e209131cea58645.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### BM25

R@10: 92.15. Result ID: 6992b8903a6c3148491104d4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

Recorded evaluation configuration: {"Supervision":"None"}. This record does not assert independent reproduction.

### Binary

R@10: 90.9. Result ID: 6992b8903a6c3148491104db.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70bd1e209131cea4cf56.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"GPT-3.5"}. This record does not assert independent reproduction.

### B-RankGPT

R@10: 90.9. Result ID: 6992b8903a6c3148491104e0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76721e209131cea6d0b1.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"List","LLM":"GPT-3.5"}. This record does not assert independent reproduction.

### Likert

R@10: 90.9. Result ID: 6992b8903a6c3148491104eb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c01e209131cea58645.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank-w/o-casc.

R@10: 90.9. Result ID: 6992b8903a6c3148491104ee.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction.

### EcoRank

R@10: 90.9. Result ID: 6992b8903a6c3148491104ef.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Implementation](<https://anonymous.4open.science/r/EcoRank>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Hybr","LLM":"T5-XL+L"}. This record does not assert independent reproduction.

### B-PRP

R@10: 86.36. Result ID: 6992b8903a6c3148491104df.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57bfb.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Pair","LLM":"GPT-3.5"}. This record does not assert independent reproduction.

### B-UPR

R@10: 77.27. Result ID: 6992b8903a6c3148491104ec.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef11e209131cea430f9.md>)

Recorded evaluation configuration: {"Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-UPR

R@10: 61.36. Result ID: 6992b8903a6c3148491104e5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef11e209131cea430f9.md>)

Recorded evaluation configuration: {"Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

### B-UPR

R@10: 59.09. Result ID: 6992b8903a6c3148491104dd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb8d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef11e209131cea430f9.md>)

Recorded evaluation configuration: {"Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
