# Information Retrieval on Bing-Click (test)

Source: [Information Retrieval on Bing-Click (test)](<https://www.sota2.com/research/sota/information-retrieval-on-bing-click-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-20T08:54:07.293Z

Evaluation of Information Retrieval performance on the test split of the Bing-Click dataset, using metrics like Recall@100 and Recall@1000.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Information Retrieval |
| Dataset (including any stated split) | Bing-Click (test) |
| Metric | Recall@100 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 38 of 38 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Recall@100](<https://www.sota2.com/research/sota/information-retrieval-on-bing-click-test.md?metric=Recall%40100>): Higher is better; unit: PERCENT.

- [Recall@1000](<https://www.sota2.com/research/sota/information-retrieval-on-bing-click-test.md?metric=Recall%401000>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Recall@100 | Result date | Report paper |
| --- | --- | --- | --- |
| m3BERT-s3 | 68.94 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 68.32 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 67.97 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s3 | 67.72 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s3 | 67.6 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 67.5 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 67.34 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 67.33 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 66.85 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 66.76 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 66.75 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s3 | 66.47 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 66.33 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 65.47 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 65.44 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 65.39 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 65.39 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 65.34 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 64.63 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 64.62 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 64.59 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 64.58 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 64.4 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 64.32 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 63.43 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s3 | 63.3 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 62.5 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 62.43 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 62.16 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s3 | 62.06 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 60.25 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 59.74 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 59.44 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 59.31 | Not recorded | 6a0d404df984739ed6737aa7 |
| m3BERT-s2 | 58.34 | Not recorded | 6a0d404df984739ed6737aa7 |
| mBERT | 57.46 | Not recorded | 6a0d404df984739ed6737aa7 |
| mE5 | 57.18 | Not recorded | 6a0d404df984739ed6737aa7 |
| ModernBERT | 57.1 | Not recorded | 6a0d404df984739ed6737aa7 |

### m3BERT-s3

Recall@100: 68.94. Result ID: 6a0d7639fbc373592c059bff.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 68.32. Result ID: 6a0d7639fbc373592c059bfc.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### mE5

Recall@100: 67.97. Result ID: 6a0d7639fbc373592c059bf4.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### m3BERT-s3

Recall@100: 67.72. Result ID: 6a0d7639fbc373592c059bec.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### m3BERT-s3

Recall@100: 67.6. Result ID: 6a0d7639fbc373592c059bfe.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 67.5. Result ID: 6a0d7639fbc373592c059bf8.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 67.34. Result ID: 6a0d7639fbc373592c059bfb.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 67.33. Result ID: 6a0d7639fbc373592c059bf0.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### mE5

Recall@100: 66.85. Result ID: 6a0d7639fbc373592c059bf3.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 66.76. Result ID: 6a0d7639fbc373592c059bef.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 66.75. Result ID: 6a0d7639fbc373592c059bf7.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### m3BERT-s3

Recall@100: 66.47. Result ID: 6a0d7639fbc373592c059beb.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 66.33. Result ID: 6a0d7639fbc373592c059be9.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 65.47. Result ID: 6a0d7638fbc373592c059be8.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 65.44. Result ID: 6a0d7639fbc373592c059bfa.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 65.39. Result ID: 6a0d7638fbc373592c059bdd.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### mE5

Recall@100: 65.39. Result ID: 6a0d7638fbc373592c059be1.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 65.34. Result ID: 6a0d7638fbc373592c059be5.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"768"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 64.63. Result ID: 6a0d7639fbc373592c059bee.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 64.62. Result ID: 6a0d7639fbc373592c059bf6.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 64.59. Result ID: 6a0d7638fbc373592c059be4.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 64.58. Result ID: 6a0d7638fbc373592c059bdc.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### mE5

Recall@100: 64.4. Result ID: 6a0d7638fbc373592c059be0.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"128"}. This record does not assert independent reproduction.

### mE5

Recall@100: 64.32. Result ID: 6a0d7639fbc373592c059bf2.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 63.43. Result ID: 6a0d7638fbc373592c059be7.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### m3BERT-s3

Recall@100: 63.3. Result ID: 6a0d7639fbc373592c059bfd.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 62.5. Result ID: 6a0d7638fbc373592c059bdb.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 62.43. Result ID: 6a0d7638fbc373592c059be3.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### mE5

Recall@100: 62.16. Result ID: 6a0d7638fbc373592c059bdf.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"64"}. This record does not assert independent reproduction.

### m3BERT-s3

Recall@100: 62.06. Result ID: 6a0d7639fbc373592c059bea.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 60.25. Result ID: 6a0d7639fbc373592c059bf9.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 59.74. Result ID: 6a0d7639fbc373592c059bed.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 59.44. Result ID: 6a0d7639fbc373592c059bf5.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### mE5

Recall@100: 59.31. Result ID: 6a0d7639fbc373592c059bf1.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Full","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### m3BERT-s2

Recall@100: 58.34. Result ID: 6a0d7638fbc373592c059be6.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### mBERT

Recall@100: 57.46. Result ID: 6a0d7638fbc373592c059bda.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### mE5

Recall@100: 57.18. Result ID: 6a0d7638fbc373592c059bde.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72491e209131cea5595a.md>)

[Implementation](<https://github.com/microsoft/unilm>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"32"}. This record does not assert independent reproduction.

### ModernBERT

Recall@100: 57.1. Result ID: 6a0d7638fbc373592c059be2.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d404df984739ed6737aa7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76471e209131cea6c1c0.md>)

Recorded evaluation configuration: {"Layer Configuration":"Lite (1/3 layers)","Embedding Dimension":"32"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
