# Moment Retrieval on DiDeMo (test)

Source: [Moment Retrieval on DiDeMo (test)](<https://www.sota2.com/research/sota/moment-retrieval-on-didemo-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-03T09:08:13.204Z

Evaluation of Moment Retrieval performance on the test split of the DiDeMo dataset, measured using R1@0.3, R1@0.5, and mIoU metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Moment Retrieval |
| Dataset (including any stated split) | DiDeMo (test) |
| Metric | R@1 (IoU=0.3) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R@1 (IoU=0.3)](<https://www.sota2.com/research/sota/moment-retrieval-on-didemo-test.md?metric=R%401%20(IoU%3D0.3)>): Higher is better; unit: PERCENT.

- [R@1 (IoU=0.5)](<https://www.sota2.com/research/sota/moment-retrieval-on-didemo-test.md?metric=R%401%20(IoU%3D0.5)>): Higher is better; unit: PERCENT.

- [mIoU](<https://www.sota2.com/research/sota/moment-retrieval-on-didemo-test.md?metric=mIoU>): Higher is better; unit: PERCENT.

## Recorded results

| Method | R@1 (IoU=0.3) | Result date | Report paper |
| --- | --- | --- | --- |
| GroundVTS-Q | 46.3 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| VTimeLLM | 45 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| HawkEye | 44.8 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| TimeChat | 42.8 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| Momenter | 38.2 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| GroundVTS-I | 37.5 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| InternVL-G | 36.6 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| VideoChat | 34.5 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| Valley | 33.2 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| QwenVL-G | 32.6 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| InternVL3.5-8B | 29.5 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| Qwen2.5-VL-7B | 28.7 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| Video-LLaMA | 20.1 | Not recorded | 69cf49bc0636e5bf4afcdbbd |
| Video-ChatGPT | 19.8 | Not recorded | 69cf49bc0636e5bf4afcdbbd |

### GroundVTS-Q

R@1 (IoU=0.3): 46.3. Result ID: 69cf835f47f34ce924b99cf0.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-VL-7B"}. This record does not assert independent reproduction.

### VTimeLLM

R@1 (IoU=0.3): 45. Result ID: 69cf835f47f34ce924b99ceb.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa715b1e209131cea50d56.md>)

[Implementation](<https://github.com/huangb23/VTimeLLM>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HawkEye

R@1 (IoU=0.3): 44.8. Result ID: 69cf835f47f34ce924b99ced.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72801e209131cea56d03.md>)

[Implementation](<https://github.com/yellow-binary-tree/HawkEye>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TimeChat

R@1 (IoU=0.3): 42.8. Result ID: 69cf835f47f34ce924b99cec.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ac1e209131cea57c30.md>)

[Implementation](<https://github.com/RenShuhuai-Andy/TimeChat>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Momenter

R@1 (IoU=0.3): 38.2. Result ID: 69cf835f47f34ce924b99cea.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73661e209131cea5c35b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GroundVTS-I

R@1 (IoU=0.3): 37.5. Result ID: 69cf835f47f34ce924b99cf3.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3.5-8B"}. This record does not assert independent reproduction.

### InternVL-G

R@1 (IoU=0.3): 36.6. Result ID: 69cf835f47f34ce924b99cf2.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### VideoChat

R@1 (IoU=0.3): 34.5. Result ID: 69cf835f47f34ce924b99ce9.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71ba1e209131cea52cc7.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Valley

R@1 (IoU=0.3): 33.2. Result ID: 69cf835f47f34ce924b99ce8.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### QwenVL-G

R@1 (IoU=0.3): 32.6. Result ID: 69cf835f47f34ce924b99cef.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### InternVL3.5-8B

R@1 (IoU=0.3): 29.5. Result ID: 69cf835f47f34ce924b99cf1.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen2.5-VL-7B

R@1 (IoU=0.3): 28.7. Result ID: 69cf835f47f34ce924b99cee.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Video-LLaMA

R@1 (IoU=0.3): 20.1. Result ID: 69cf835f47f34ce924b99ce6.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e393.md>)

[Implementation](<https://github.com/DAMO-NLP-SG/Video-LLaMA>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Video-ChatGPT

R@1 (IoU=0.3): 19.8. Result ID: 69cf835f47f34ce924b99ce7.

[Reporting paper](<https://www.sota2.com/research/paper/69cf49bc0636e5bf4afcdbbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73841e209131cea5ce32.md>)

[Implementation](<https://github.com/mbzuai-oryx/Video-ChatGPT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
