# Passage Ranking on WebQuestions (WQ) Source: [Passage Ranking on WebQuestions (WQ)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:59:39.114Z Evaluation of model performance on the WebQuestions (WQ) dataset for Passage Ranking tasks, measured using rank-based metrics such as R@10. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Passage Ranking | | Dataset (including any stated split) | WebQuestions (WQ) | | Metric | R@10 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 36 of 36 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [R@10](): Higher is better; unit: PERCENT. - [MRR](): Higher is better; unit: PERCENT. - [R@1](): Higher is better; unit: PERCENT. ## Recorded results | Method | R@10 | Result date | Report paper | | --- | --- | --- | --- | | monot5-3B | 63.97 | Not recorded | 68fa734f1e209131cea5bb8d | | EcoRank | 63.58 | Not recorded | 68fa734f1e209131cea5bb8d | | monot5-base | 62.94 | Not recorded | 68fa734f1e209131cea5bb8d | | monoBERT | 62.94 | Not recorded | 68fa734f1e209131cea5bb8d | | TART | 62.64 | Not recorded | 68fa734f1e209131cea5bb8d | | InPars | 62.25 | Not recorded | 68fa734f1e209131cea5bb8d | | Likert | 62.05 | Not recorded | 68fa734f1e209131cea5bb8d | | InPars | 61.95 | Not recorded | 68fa734f1e209131cea5bb8d | | Binary | 61.76 | Not recorded | 68fa734f1e209131cea5bb8d | | InPars | 61.66 | Not recorded | 68fa734f1e209131cea5bb8d | | Likert | 60.92 | Not recorded | 68fa734f1e209131cea5bb8d | | B-PRP | 60.53 | Not recorded | 68fa734f1e209131cea5bb8d | | EcoRank | 60.33 | Not recorded | 68fa734f1e209131cea5bb8d | | Binary | 59.64 | Not recorded | 68fa734f1e209131cea5bb8d | | Likert | 57.77 | Not recorded | 68fa734f1e209131cea5bb8d | | Binary | 57.08 | Not recorded | 68fa734f1e209131cea5bb8d | | B-RankGPT | 56.88 | Not recorded | 68fa734f1e209131cea5bb8d | | EcoRank-w/o-casc. | 56.79 | Not recorded | 68fa734f1e209131cea5bb8d | | Binary | 56.74 | Not recorded | 68fa734f1e209131cea5bb8d | | EcoRank | 56.69 | Not recorded | 68fa734f1e209131cea5bb8d | | B-PRP | 55.65 | Not recorded | 68fa734f1e209131cea5bb8d | | EcoRank-w/o-casc. | 55.21 | Not recorded | 68fa734f1e209131cea5bb8d | | B-UPR | 54.8 | Not recorded | 68fa734f1e209131cea5bb8d | | B-PRP | 53.65 | Not recorded | 68fa734f1e209131cea5bb8d | | BM25 | 52.16 | Not recorded | 68fa734f1e209131cea5bb8d | | B-UPR | 52.16 | Not recorded | 68fa734f1e209131cea5bb8d | | B-PRP | 52.16 | Not recorded | 68fa734f1e209131cea5bb8d | | B-UPR | 52.16 | Not recorded | 68fa734f1e209131cea5bb8d | ### monot5-3B R@10: 63.97. Result ID: 6992b8903a6c31484911049e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-3B"}. This record does not assert independent reproduction. ### EcoRank R@10: 63.58. Result ID: 6992b8903a6c3148491104a9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction. ### monot5-base R@10: 62.94. Result ID: 6992b8903a6c31484911049d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-base"}. This record does not assert independent reproduction. ### monoBERT R@10: 62.94. Result ID: 6992b8903a6c31484911049f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"BERT"}. This record does not assert independent reproduction. ### TART R@10: 62.64. Result ID: 6992b8903a6c3148491104a0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Supervised","LLM":"T5-XL"}. This record does not assert independent reproduction. ### InPars R@10: 62.25. Result ID: 6992b8903a6c3148491104b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B3","LLM":"T5-large"}. This record does not assert independent reproduction. ### Likert R@10: 62.05. Result ID: 6992b8903a6c3148491104a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### InPars R@10: 61.95. Result ID: 6992b8903a6c3148491104a1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","LLM":"T5-large"}. This record does not assert independent reproduction. ### Binary R@10: 61.76. Result ID: 6992b8903a6c3148491104a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### InPars R@10: 61.66. Result ID: 6992b8903a6c3148491104aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B2","LLM":"T5-large"}. This record does not assert independent reproduction. ### Likert R@10: 60.92. Result ID: 6992b8903a6c3148491104ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### B-PRP R@10: 60.53. Result ID: 6992b8903a6c3148491104a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction. ### EcoRank R@10: 60.33. Result ID: 6992b8903a6c3148491104b0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B2","Strategy":"Hybr","LLM":"T5-XL+L"}. This record does not assert independent reproduction. ### Binary R@10: 59.64. Result ID: 6992b8903a6c3148491104ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### Likert R@10: 57.77. Result ID: 6992b8903a6c3148491104b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### Binary R@10: 57.08. Result ID: 6992b8903a6c3148491104b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### B-RankGPT R@10: 56.88. Result ID: 6992b8903a6c3148491104a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"List","LLM":"GPT-3.5"}. This record does not assert independent reproduction. ### EcoRank-w/o-casc. R@10: 56.79. Result ID: 6992b8903a6c3148491104af. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B2","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction. ### Binary R@10: 56.74. Result ID: 6992b8903a6c3148491104a3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"Point","LLM":"GPT-3.5"}. This record does not assert independent reproduction. ### EcoRank R@10: 56.69. Result ID: 6992b8903a6c3148491104b7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B3","Strategy":"Hybr","LLM":"T5-XL+L"}. This record does not assert independent reproduction. ### B-PRP R@10: 55.65. Result ID: 6992b8903a6c3148491104ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B2","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction. ### EcoRank-w/o-casc. R@10: 55.21. Result ID: 6992b8903a6c3148491104b6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B3","Strategy":"Hybr","LLM":"T5-XL"}. This record does not assert independent reproduction. ### B-UPR R@10: 54.8. Result ID: 6992b8903a6c3148491104b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B3","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### B-PRP R@10: 53.65. Result ID: 6992b8903a6c3148491104b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B3","Strategy":"Pair","LLM":"T5-XL"}. This record does not assert independent reproduction. ### BM25 R@10: 52.16. Result ID: 6992b8903a6c31484911049c. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"None"}. This record does not assert independent reproduction. ### B-UPR R@10: 52.16. Result ID: 6992b8903a6c3148491104a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. ### B-PRP R@10: 52.16. Result ID: 6992b8903a6c3148491104a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B1","Strategy":"Pair","LLM":"GPT-3.5"}. This record does not assert independent reproduction. ### B-UPR R@10: 52.16. Result ID: 6992b8903a6c3148491104ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised","Budget":"B2","Strategy":"Point","LLM":"T5-XL"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.