# Ad hoc document retrieval on TREC Microblog 2011 (test)

Source: [Ad hoc document retrieval on TREC Microblog 2011 (test)](<https://www.sota2.com/research/sota/ad-hoc-document-retrieval-on-trec-microblog-2011-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:22:37.972Z

Evaluation of Ad hoc Document Retrieval performance on the test split of the TREC Microblog 2011 dataset, measured using AP and P30.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ad hoc document retrieval |
| Dataset (including any stated split) | TREC Microblog 2011 (test) |
| Metric | AP |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AP](<https://www.sota2.com/research/sota/ad-hoc-document-retrieval-on-trec-microblog-2011-test.md?metric=AP>): Higher is better; unit: PERCENT.

- [P@30](<https://www.sota2.com/research/sota/ad-hoc-document-retrieval-on-trec-microblog-2011-test.md?metric=P%4030>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AP | Result date | Report paper |
| --- | --- | --- | --- |
| BERT | 46.97 | Not recorded | 68fa65841e209131cea0aba2 |
| BiCNN | 42.93 | Not recorded | 68fa65841e209131cea0aba2 |
| MP-HCNN | 40.43 | Not recorded | 68fa65841e209131cea0aba2 |
| RM3 | 38.24 | Not recorded | 68fa65841e209131cea0aba2 |
| PACRR | 38.1 | Not recorded | 68fa65841e209131cea0aba2 |
| QL | 35.76 | Not recorded | 68fa65841e209131cea0aba2 |
| DUET | 35.76 | Not recorded | 68fa65841e209131cea0aba2 |
| K-NRM | 35.76 | Not recorded | 68fa65841e209131cea0aba2 |
| DRMM | 34.77 | Not recorded | 68fa65841e209131cea0aba2 |

### BERT

AP: 46.97. Result ID: 698cb1158b517eb4331c1650.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Implementation](<https://github.com/castorini/Anserini/blob/master/docs/%20experiments-forum2018.md>)

Recorded evaluation configuration: {"mode":"fine-tuned"}. This record does not assert independent reproduction.

### BiCNN

AP: 42.93. Result ID: 698cb1158b517eb4331c164f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66401e209131cea0f2ee.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MP-HCNN

AP: 40.43. Result ID: 698cb1158b517eb4331c164e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65f71e209131cea0d879.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RM3

AP: 38.24. Result ID: 698cb1158b517eb4331c1649.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PACRR

AP: 38.1. Result ID: 698cb1158b517eb4331c164d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63801e209131ce9fef93.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### QL

AP: 35.76. Result ID: 698cb1158b517eb4331c1648.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DUET

AP: 35.76. Result ID: 698cb1158b517eb4331c164b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d21e209131ce9fb51e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### K-NRM

AP: 35.76. Result ID: 698cb1158b517eb4331c164c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa636e1e209131ce9fec2b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DRMM

AP: 34.77. Result ID: 698cb1158b517eb4331c164a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65841e209131cea0aba2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
