# Dynamic Corpus Retrieval on NQ320K D (train)

Source: [Dynamic Corpus Retrieval on NQ320K D (train)](<https://www.sota2.com/research/sota/dynamic-corpus-retrieval-on-nq320k-d-train>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-27T09:40:58.978Z

Evaluation of model performance on the training split (D) of the NQ320K dataset for Dynamic Corpus Retrieval, measured using Hits@1 and Hits@10.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Dynamic Corpus Retrieval |
| Dataset (including any stated split) | NQ320K D (train) |
| Metric | Hits@1 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Hits@1](<https://www.sota2.com/research/sota/dynamic-corpus-retrieval-on-nq320k-d-train.md?metric=Hits%401>): Higher is better; unit: SCALAR.

- [Hits@10](<https://www.sota2.com/research/sota/dynamic-corpus-retrieval-on-nq320k-d-train.md?metric=Hits%4010>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Hits@1 | Result date | Report paper |
| --- | --- | --- | --- |
| ICICLE | 0.483 | Not recorded | 6a167ac3dbd7150506f80166 |
| DPR\* | 0.471 | Not recorded | 6a167ac3dbd7150506f80166 |
| From Scratch | 0.45 | Not recorded | 6a167ac3dbd7150506f80166 |
| DSI | 0.424 | Not recorded | 6a167ac3dbd7150506f80166 |
| DOME | 0.424 | Not recorded | 6a167ac3dbd7150506f80166 |
| DSI++ | 0.422 | Not recorded | 6a167ac3dbd7150506f80166 |
| New-Doc FT | 0.418 | Not recorded | 6a167ac3dbd7150506f80166 |
| BM25\* | 0.386 | Not recorded | 6a167ac3dbd7150506f80166 |

### ICICLE

Hits@1: 0.483. Result ID: 6a16bc06fbc373592c1046b2.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train ∪ D\_new","Unseen Corpus Update Cost":"–"}. This record does not assert independent reproduction.

### DPR\*

Hits@1: 0.471. Result ID: 6a16bc06fbc373592c1046ad.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa686d1e209131cea1c190.md>)

[Implementation](<https://github.com/facebookresearch/DPR>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train ∪ D\_new","Unseen Corpus Update Cost":"–"}. This record does not assert independent reproduction.

### From Scratch

Hits@1: 0.45. Result ID: 6a16bc06fbc373592c1046ae.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train ∪ D\_new","Unseen Corpus Update Cost":"O(N + M)"}. This record does not assert independent reproduction.

### DSI

Hits@1: 0.424. Result ID: 6a16bc06fbc373592c1046ab.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bc9d.md>)

[Implementation](<https://github.com/google-research/t5x>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train","Unseen Corpus Update Cost":"–"}. This record does not assert independent reproduction.

### DOME

Hits@1: 0.424. Result ID: 6a16bc06fbc373592c1046b1.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a7bc7b2d603e6de3e3d416.md>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train ∪ D\_new","Unseen Corpus Update Cost":"O(M)"}. This record does not assert independent reproduction.

### DSI++

Hits@1: 0.422. Result ID: 6a16bc06fbc373592c1046b0.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71661e209131cea512ea.md>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train ∪ D\_new","Unseen Corpus Update Cost":"O(M)"}. This record does not assert independent reproduction.

### New-Doc FT

Hits@1: 0.418. Result ID: 6a16bc06fbc373592c1046af.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71661e209131cea512ea.md>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train ∪ D\_new","Unseen Corpus Update Cost":"O(M)"}. This record does not assert independent reproduction.

### BM25\*

Hits@1: 0.386. Result ID: 6a16bc06fbc373592c1046ac.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ac3dbd7150506f80166.md>)

Recorded evaluation configuration: {"Indexing Strategy":"Indexed on D\_train ∪ D\_new","Unseen Corpus Update Cost":"–"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
