# Ad-hoc Retrieval on ClueWeb-09 Cat-B Topic descriptions (test)

Source: [Ad-hoc Retrieval on ClueWeb-09 Cat-B Topic descriptions (test)](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-descriptions-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:49:34.473Z

Evaluation of Ad-hoc Retrieval performance using the test split of the ClueWeb-09 Cat-B Topic descriptions dataset, measured by MAP, nDCG@20, and P@20.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ad-hoc Retrieval |
| Dataset (including any stated split) | ClueWeb-09 Cat-B Topic descriptions (test) |
| Metric | MAP |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAP](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-descriptions-test.md?metric=MAP>): Higher is better; unit: SCALAR.

- [nDCG@20](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-descriptions-test.md?metric=nDCG%4020>): Higher is better; unit: SCALAR.

- [P@20](<https://www.sota2.com/research/sota/ad-hoc-retrieval-on-clueweb-09-cat-b-topic-descriptions-test.md?metric=P%4020>): Higher is better; unit: SCALAR.

## Recorded results

| Method | MAP | Result date | Report paper |
| --- | --- | --- | --- |
| DRMM\_LCHxIDF | 0.087 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_LCHxTV | 0.083 | Not recorded | 68fa63d01e209131cea00dca |
| BM25 | 0.08 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_CHxIDF | 0.077 | Not recorded | 68fa63d01e209131cea00dca |
| QL | 0.075 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_CHxTV | 0.072 | Not recorded | 68fa63d01e209131cea00dca |
| MP\_COS | 0.057 | Not recorded | 68fa63d01e209131cea00dca |
| CDSSM\_T | 0.055 | Not recorded | 68fa63d01e209131cea00dca |
| CDSSM\_D | 0.049 | Not recorded | 68fa63d01e209131cea00dca |
| DSSM\_T | 0.046 | Not recorded | 68fa63d01e209131cea00dca |
| MP\_IND | 0.043 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_NHxIDF | 0.038 | Not recorded | 68fa63d01e209131cea00dca |
| DSSM\_D | 0.034 | Not recorded | 68fa63d01e209131cea00dca |
| MP\_DOT | 0.033 | Not recorded | 68fa63d01e209131cea00dca |
| DRMM\_NHxTV | 0.031 | Not recorded | 68fa63d01e209131cea00dca |
| ARC-II | 0.024 | Not recorded | 68fa63d01e209131cea00dca |
| ARC-I | 0.017 | Not recorded | 68fa63d01e209131cea00dca |

### DRMM\_LCHxIDF

MAP: 0.087. Result ID: 698c034df729bc7f68e7b6e6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Log-Count","Weighting":"IDF"}. This record does not assert independent reproduction.

### DRMM\_LCHxTV

MAP: 0.083. Result ID: 698c034df729bc7f68e7b6e3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Log-Count","Weighting":"Term Vector"}. This record does not assert independent reproduction.

### BM25

MAP: 0.08. Result ID: 698c034df729bc7f68e7b6d7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Traditional Retrieval Baselines"}. This record does not assert independent reproduction.

### DRMM\_CHxIDF

MAP: 0.077. Result ID: 698c034df729bc7f68e7b6e4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Count","Weighting":"IDF"}. This record does not assert independent reproduction.

### QL

MAP: 0.075. Result ID: 698c034df729bc7f68e7b6d6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Traditional Retrieval Baselines"}. This record does not assert independent reproduction.

### DRMM\_CHxTV

MAP: 0.072. Result ID: 698c034df729bc7f68e7b6e1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Count","Weighting":"Term Vector"}. This record does not assert independent reproduction.

### MP\_COS

MAP: 0.057. Result ID: 698c034df729bc7f68e7b6df.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62471e209131ce9f87f2.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### CDSSM\_T

MAP: 0.055. Result ID: 698c034df729bc7f68e7b6da.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### CDSSM\_D

MAP: 0.049. Result ID: 698c034df729bc7f68e7b6db.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### DSSM\_T

MAP: 0.046. Result ID: 698c034df729bc7f68e7b6d8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### MP\_IND

MAP: 0.043. Result ID: 698c034df729bc7f68e7b6de.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62471e209131ce9f87f2.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### DRMM\_NHxIDF

MAP: 0.038. Result ID: 698c034df729bc7f68e7b6e5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Normalized","Weighting":"IDF"}. This record does not assert independent reproduction.

### DSSM\_D

MAP: 0.034. Result ID: 698c034df729bc7f68e7b6d9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

### MP\_DOT

MAP: 0.033. Result ID: 698c034df729bc7f68e7b6e0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62471e209131ce9f87f2.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### DRMM\_NHxTV

MAP: 0.031. Result ID: 698c034df729bc7f68e7b6e2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching","Histogram":"Normalized","Weighting":"Term Vector"}. This record does not assert independent reproduction.

### ARC-II

MAP: 0.024. Result ID: 698c034df729bc7f68e7b6dd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61b91e209131ce9f5c09.md>)

[Implementation](<http://www.noahlab.com.hk/technology/Learning2Match.html>)

Recorded evaluation configuration: {"Model Type":"Interaction-Focused Matching Baselines"}. This record does not assert independent reproduction.

### ARC-I

MAP: 0.017. Result ID: 698c034df729bc7f68e7b6dc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa63d01e209131cea00dca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61b91e209131ce9f5c09.md>)

[Implementation](<http://www.noahlab.com.hk/technology/Learning2Match.html>)

Recorded evaluation configuration: {"Model Type":"Representation-Focused Matching Baselines"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.