# Ad-hoc Retrieval on ClueWeb-09-Cat-B Topic titles (test)

Source: [Ad-hoc Retrieval on ClueWeb-09-Cat-B Topic titles (test)](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-titles-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:49:34.457Z

Evaluation of Ad-hoc Retrieval performance on the test split of the ClueWeb-09 Category B Topic titles subset, measured using MAP, nDCG@20, and P@20.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ad-hoc Retrieval |
| Dataset (including any stated split) | ClueWeb-09-Cat-B Topic titles (test) |
| Metric | MAP |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAP](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-titles-test.md?metric=MAP>): Higher is better; unit: PERCENT.

- [nDCG@20](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-titles-test.md?metric=nDCG%4020>): Higher is better; unit: PERCENT.

- [P@20](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-titles-test.md?metric=P%4020>): Higher is better; unit: PERCENT.

## Recorded results

| Method | MAP | Result date | Report paper |
| --- | --- | --- | --- |
| DRMM\_LCHxIDF | 11.3 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_LCHxTV | 11.1 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_CHxIDF | 10.4 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_CHxTV | 10.3 | Not recorded | 68fa63d01e209131cea00dca |
| BM25 | 10.1 | Not recorded | 68fa63d01e209131cea00dca |
| QL | 10 | Not recorded | 68fa63d01e209131cea00dca |
| MP\_COS | 6.6 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_NHxIDF | 6.6 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_NHxTV | 6.5 | Not recorded | 68fa63d01e209131cea00dca |
| CDSSM\_T | 6.4 | Not recorded | 68fa63d01e209131cea00dca |
| MP\_IND | 5.6 | Not recorded | 68fa63d01e209131cea00dca |
| DSSM\_T | 5.4 | Not recorded | 68fa63d01e209131cea00dca |
| CDSSM\_D | 5.4 | Not recorded | 68fa63d01e209131cea00dca |
| MP\_DOT | 4.4 | Not recorded | 68fa63d01e209131cea00dca |
| DSSM\_D | 3.9 | Not recorded | 68fa63d01e209131cea00dca |
| ARC-II | 3.3 | Not recorded | 68fa63d01e209131cea00dca |
| ARC-I | 2.4 | Not recorded | 68fa63d01e209131cea00dca |

### DRMM\_LCHxIDF

MAP: 11.3. Result ID: 698c034df729bc7f68e7b6d5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Log-Count","Weighting":"IDF"}. This record does not assert independent reproduction.

### DRMM\_LCHxTV

MAP: 11.1. Result ID: 698c034df729bc7f68e7b6d2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Log-Count","Weighting":"Term Vector"}. This record does not assert independent reproduction.

### DRMM\_CHxIDF

MAP: 10.4. Result ID: 698c034df729bc7f68e7b6d3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Count","Weighting":"IDF"}. This record does not assert independent reproduction.

### DRMM\_CHxTV

MAP: 10.3. Result ID: 698c034df729bc7f68e7b6d0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Count","Weighting":"Term Vector"}. This record does not assert independent reproduction.

### BM25

MAP: 10.1. Result ID: 698c034df729bc7f68e7b6c6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Traditional Retrieval Baselines"}. This record does not assert independent reproduction.

### QL

MAP: 10. Result ID: 698c034df729bc7f68e7b6c5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Traditional Retrieval Baselines"}. This record does not assert independent reproduction.

### MP\_COS

MAP: 6.6. Result ID: 698c034df729bc7f68e7b6ce.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62471e209131ce9f87f2.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### DRMM\_NHxIDF

MAP: 6.6. Result ID: 698c034df729bc7f68e7b6d4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Normalized","Weighting":"IDF"}. This record does not assert independent reproduction.

### DRMM\_NHxTV

MAP: 6.5. Result ID: 698c034df729bc7f68e7b6d1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Normalized","Weighting":"Term Vector"}. This record does not assert independent reproduction.

### CDSSM\_T

MAP: 6.4. Result ID: 698c034df729bc7f68e7b6c9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### MP\_IND

MAP: 5.6. Result ID: 698c034df729bc7f68e7b6cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62471e209131ce9f87f2.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### DSSM\_T

MAP: 5.4. Result ID: 698c034df729bc7f68e7b6c7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### CDSSM\_D

MAP: 5.4. Result ID: 698c034df729bc7f68e7b6ca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### MP\_DOT

MAP: 4.4. Result ID: 698c034df729bc7f68e7b6cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62471e209131ce9f87f2.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### DSSM\_D

MAP: 3.9. Result ID: 698c034df729bc7f68e7b6c8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### ARC-II

MAP: 3.3. Result ID: 698c034df729bc7f68e7b6cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61b91e209131ce9f5c09.md>)

[Implementation](<http://www.noahlab.com.hk/technology/Learning2Match.html>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### ARC-I

MAP: 2.4. Result ID: 698c034df729bc7f68e7b6cb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61b91e209131ce9f5c09.md>)

[Implementation](<http://www.noahlab.com.hk/technology/Learning2Match.html>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
