# Page Retrieval on MMDocIR 1.0 (full)

Source: [Page Retrieval on MMDocIR 1.0 (full)](<https://www.sota2.com/research/sota/page-retrieval-on-mmdocir-1-0-full>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-27T10:14:01.464Z

Evaluation of Page Retrieval performance on the full set of the MMDocIR 1.0 dataset, reporting Macro and Micro Recall scores at ranks 1, 3, and 5.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Page Retrieval |
| Dataset (including any stated split) | MMDocIR 1.0 (full) |
| Metric | Macro R@1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Macro R@1](<https://www.sota2.com/research/sota/page-retrieval-on-mmdocir-1-0-full.md?metric=Macro%20R%401>): Higher is better; unit: PERCENT.

- [Macro R@3](<https://www.sota2.com/research/sota/page-retrieval-on-mmdocir-1-0-full.md?metric=Macro%20R%403>): Higher is better; unit: PERCENT.

- [Macro R@5](<https://www.sota2.com/research/sota/page-retrieval-on-mmdocir-1-0-full.md?metric=Macro%20R%405>): Higher is better; unit: PERCENT.

- [Micro R@1](<https://www.sota2.com/research/sota/page-retrieval-on-mmdocir-1-0-full.md?metric=Micro%20R%401>): Higher is better; unit: PERCENT.

- [Micro R@3](<https://www.sota2.com/research/sota/page-retrieval-on-mmdocir-1-0-full.md?metric=Micro%20R%403>): Higher is better; unit: PERCENT.

- [Micro R@5](<https://www.sota2.com/research/sota/page-retrieval-on-mmdocir-1-0-full.md?metric=Micro%20R%405>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Macro R@1 | Result date | Report paper |
| --- | --- | --- | --- |
| Qwen3-VL-8B | 64.7 | Not recorded | 6a167ad5dbd7150506f802bb |
| Qwen3-VL-8B | 61.8 | Not recorded | 6a167ad5dbd7150506f802bb |
| Col-Phi3MMDocIR | 57 | Not recorded | 6a167ad5dbd7150506f802bb |
| DPR-Phi3MMDocIR | 54.1 | Not recorded | 6a167ad5dbd7150506f802bb |
| ColPali | 53 | Not recorded | 6a167ad5dbd7150506f802bb |
| Gemma3-12B | 51.8 | Not recorded | 6a167ad5dbd7150506f802bb |
| DSEdocmatix | 50.2 | Not recorded | 6a167ad5dbd7150506f802bb |
| Gemma3-12B | 49.4 | Not recorded | 6a167ad5dbd7150506f802bb |
| DSEwiki-ss | 48 | Not recorded | 6a167ad5dbd7150506f802bb |
| ColBERT | 45.8 | Not recorded | 6a167ad5dbd7150506f802bb |
| Contriever | 40.9 | Not recorded | 6a167ad5dbd7150506f802bb |
| E5 | 40.8 | Not recorded | 6a167ad5dbd7150506f802bb |
| BGE | 40.6 | Not recorded | 6a167ad5dbd7150506f802bb |
| GTE | 38.9 | Not recorded | 6a167ad5dbd7150506f802bb |
| DPR | 27.2 | Not recorded | 6a167ad5dbd7150506f802bb |

### Qwen3-VL-8B

Macro R@1: 64.7. Result ID: 6a16c3d6fbc373592c108202.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

Recorded evaluation configuration: {"Scoring":"LVLM attn.","Attention strategy":"selected heads (MMRetHeads)"}. This record does not assert independent reproduction.

### Qwen3-VL-8B

Macro R@1: 61.8. Result ID: 6a16c3d6fbc373592c108200.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

Recorded evaluation configuration: {"Scoring":"LVLM attn.","Attention strategy":"all-head attention"}. This record does not assert independent reproduction.

### Col-Phi3MMDocIR

Macro R@1: 57. Result ID: 6a16c3d6fbc373592c1081ff.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79a85.md>)

Recorded evaluation configuration: {"Scoring":"Image"}. This record does not assert independent reproduction.

### DPR-Phi3MMDocIR

Macro R@1: 54.1. Result ID: 6a16c3d6fbc373592c1081fe.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79a85.md>)

Recorded evaluation configuration: {"Scoring":"Image"}. This record does not assert independent reproduction.

### ColPali

Macro R@1: 53. Result ID: 6a16c3d6fbc373592c1081fd.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77261e209131cea7161f.md>)

Recorded evaluation configuration: {"Scoring":"Image"}. This record does not assert independent reproduction.

### Gemma3-12B

Macro R@1: 51.8. Result ID: 6a16c3d6fbc373592c108203.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

Recorded evaluation configuration: {"Scoring":"LVLM attn.","Attention strategy":"selected heads (MMRetHeads)"}. This record does not assert independent reproduction.

### DSEdocmatix

Macro R@1: 50.2. Result ID: 6a16c3d6fbc373592c1081fc.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76011e209131cea6addd.md>)

Recorded evaluation configuration: {"Scoring":"Image"}. This record does not assert independent reproduction.

### Gemma3-12B

Macro R@1: 49.4. Result ID: 6a16c3d6fbc373592c108201.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

Recorded evaluation configuration: {"Scoring":"LVLM attn.","Attention strategy":"all-global attention"}. This record does not assert independent reproduction.

### DSEwiki-ss

Macro R@1: 48. Result ID: 6a16c3d6fbc373592c1081fb.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76011e209131cea6addd.md>)

Recorded evaluation configuration: {"Scoring":"Image"}. This record does not assert independent reproduction.

### ColBERT

Macro R@1: 45.8. Result ID: 6a16c3d6fbc373592c1081f6.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67a71e209131cea1780b.md>)

Recorded evaluation configuration: {"Scoring":"VLM-text"}. This record does not assert independent reproduction.

### Contriever

Macro R@1: 40.9. Result ID: 6a16c3d6fbc373592c1081f9.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d4b1e209131cea38d50.md>)

[Implementation](<https://github.com/facebookresearch/contriever>)

Recorded evaluation configuration: {"Scoring":"VLM-text"}. This record does not assert independent reproduction.

### E5

Macro R@1: 40.8. Result ID: 6a16c3d6fbc373592c1081f8.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

Recorded evaluation configuration: {"Scoring":"VLM-text"}. This record does not assert independent reproduction.

### BGE

Macro R@1: 40.6. Result ID: 6a16c3d6fbc373592c1081f7.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

Recorded evaluation configuration: {"Scoring":"VLM-text"}. This record does not assert independent reproduction.

### GTE

Macro R@1: 38.9. Result ID: 6a16c3d6fbc373592c1081fa.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

Recorded evaluation configuration: {"Scoring":"VLM-text"}. This record does not assert independent reproduction.

### DPR

Macro R@1: 27.2. Result ID: 6a16c3d6fbc373592c1081f5.

[Reporting paper](<https://www.sota2.com/research/paper/6a167ad5dbd7150506f802bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa686d1e209131cea1c190.md>)

[Implementation](<https://github.com/facebookresearch/DPR>)

Recorded evaluation configuration: {"Scoring":"VLM-text"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
