# Multi-video Grounding and Retrieval on MAGMaR Oracle Track 2026 (val)

Source: [Multi-video Grounding and Retrieval on MAGMaR Oracle Track 2026 (val)](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-19T08:01:28.794Z

Evaluation of Multi-video Grounding and Retrieval performance on the validation split of the MAGMaR Oracle Track 2026 dataset, utilizing human evaluation and reference-based F1 metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-video Grounding and Retrieval |
| Dataset (including any stated split) | MAGMaR Oracle Track 2026 (val) |
| Metric | Human Evaluation Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Human Evaluation Score](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Human%20Evaluation%20Score>): Higher is better; unit: SCALAR.

- [Best Votes Count](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Best%20Votes%20Count>): Higher is better; unit: SCALAR.

- [Avg. F1](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Avg.%20F1>): Higher is better; unit: PERCENT.

- [Ref Info Precision](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Ref%20Info%20Precision>): Higher is better; unit: PERCENT.

- [Ref Info Recall](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Ref%20Info%20Recall>): Higher is better; unit: PERCENT.

- [Ref Info F1](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Ref%20Info%20F1>): Higher is better; unit: PERCENT.

- [Ref Cite Precision](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Ref%20Cite%20Precision>): Higher is better; unit: PERCENT.

- [Ref Cite Recall](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Ref%20Cite%20Recall>): Higher is better; unit: PERCENT.

- [Ref Cite F1](<https://www.sota2.com/research/sota/multi-video-grounding-and-retrieval-on-magmar-oracle-track-2026-val.md?metric=Ref%20Cite%20F1>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Human Evaluation Score | Result date | Report paper |
| --- | --- | --- | --- |
| MARS-iter-qa-base | 3.833 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| TRACE (Ours) | 3.825 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| MARS-iter-qa-ginger | 3.694 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| MARS-ss-qa-ginger | 3.421 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| MARS-RLM | 3.298 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| MARS-Ginger | 3.123 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| CAG | 3.088 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| MARS-ss-qa-base | 3.07 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| MARS-Bullet | 2.667 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| CiteChasers | 2.542 | Not recorded | 6a0bee75dbc836b87d82c2cf |
| HAIVLab | 2.526 | Not recorded | 6a0bee75dbc836b87d82c2cf |

### MARS-iter-qa-base

Human Evaluation Score: 3.833. Result ID: 6a0c18cefbc373592c01fd02.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TRACE (Ours)

Human Evaluation Score: 3.825. Result ID: 6a0c18cefbc373592c01fd03.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MARS-iter-qa-ginger

Human Evaluation Score: 3.694. Result ID: 6a0c18cefbc373592c01fd00.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MARS-ss-qa-ginger

Human Evaluation Score: 3.421. Result ID: 6a0c18cefbc373592c01fd01.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MARS-RLM

Human Evaluation Score: 3.298. Result ID: 6a0c18cefbc373592c01fcff.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MARS-Ginger

Human Evaluation Score: 3.123. Result ID: 6a0c18cefbc373592c01fcfe.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CAG

Human Evaluation Score: 3.088. Result ID: 6a0c18cefbc373592c01fcfd.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c6f1e209131cea8e0ef.md>)

Recorded evaluation configuration: {"status":"baseline"}. This record does not assert independent reproduction.

### MARS-ss-qa-base

Human Evaluation Score: 3.07. Result ID: 6a0c18cefbc373592c01fcfc.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MARS-Bullet

Human Evaluation Score: 2.667. Result ID: 6a0c18cefbc373592c01fcfb.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CiteChasers

Human Evaluation Score: 2.542. Result ID: 6a0c18cefbc373592c01fcfa.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HAIVLab

Human Evaluation Score: 2.526. Result ID: 6a0c18cefbc373592c01fcf9.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee75dbc836b87d82c2cf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
