# Movie Retrieval on LSMDC 17 (public test)

Source: [Movie Retrieval on LSMDC 17 (public test)](<https://www.sota2.com/research/sota/movie-retrieval-on-lsmdc-17-public-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:01:21.037Z

Evaluation of Movie Retrieval performance on the public test split of the LSMDC 17 dataset, measured using Rank-based metrics (Recall@K, Median Rank).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Movie Retrieval |
| Dataset (including any stated split) | LSMDC 17 (public test) |
| Metric | Recall@1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Recall@1](<https://www.sota2.com/research/sota/movie-retrieval-on-lsmdc-17-public-test.md?metric=Recall%401>): Higher is better; unit: PERCENT.

- [Recall@5](<https://www.sota2.com/research/sota/movie-retrieval-on-lsmdc-17-public-test.md?metric=Recall%405>): Higher is better; unit: PERCENT.

- [Recall@10](<https://www.sota2.com/research/sota/movie-retrieval-on-lsmdc-17-public-test.md?metric=Recall%4010>): Higher is better; unit: PERCENT.

- [Median Rank](<https://www.sota2.com/research/sota/movie-retrieval-on-lsmdc-17-public-test.md?metric=Median%20Rank>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Recall@1 | Result date | Report paper |
| --- | --- | --- | --- |
| JSFusion | 9.1 | Not recorded | 68fa64a41e209131cea05ce8 |
| JSFusion-noaudio | 9 | Not recorded | 68fa64a41e209131cea05ce8 |
| JSTlstm | 7.6 | Not recorded | 68fa64a41e209131cea05ce8 |
| JSTmean | 7.5 | Not recorded | 68fa64a41e209131cea05ce8 |
| Miech et al. | 7.3 | Not recorded | 68fa64a41e209131cea05ce8 |
| JSTmax | 6.7 | Not recorded | 68fa64a41e209131cea05ce8 |
| JSFusion-noattention | 6.4 | Not recorded | 68fa64a41e209131cea05ce8 |
| EITanque | 4.7 | Not recorded | 68fa64a41e209131cea05ce8 |
| JSTfc | 4.7 | Not recorded | 68fa64a41e209131cea05ce8 |
| CT-SAN | 4.5 | Not recorded | 68fa64a41e209131cea05ce8 |
| C+LSTM+SA-FC7 | 4.3 | Not recorded | 68fa64a41e209131cea05ce8 |
| SNUVL | 3.6 | Not recorded | 68fa64a41e209131cea05ce8 |
| LSTM+SA-FC7 | 3.3 | Not recorded | 68fa64a41e209131cea05ce8 |
| VSE-LSTM | 3.1 | Not recorded | 68fa64a41e209131cea05ce8 |
| LSTM-fusion | 3 | Not recorded | 68fa64a41e209131cea05ce8 |
| SA-G+SA-FC7 | 3 | Not recorded | 68fa64a41e209131cea05ce8 |

### JSFusion

Recall@1: 9.1. Result ID: 698c4fd137894ef7d9cd6c2f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Implementation](<http://vision.snu.ac.kr/projects/jsfusion/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### JSFusion-noaudio

Recall@1: 9. Result ID: 698c4fd137894ef7d9cd6c2e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Implementation](<http://vision.snu.ac.kr/projects/jsfusion/>)

Recorded evaluation configuration: {"audio":false}. This record does not assert independent reproduction.

### JSTlstm

Recall@1: 7.6. Result ID: 698c4fd137894ef7d9cd6c2a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Implementation](<http://vision.snu.ac.kr/projects/jsfusion/>)

Recorded evaluation configuration: {"variant":"lstm"}. This record does not assert independent reproduction.

### JSTmean

Recall@1: 7.5. Result ID: 698c4fd137894ef7d9cd6c2c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Implementation](<http://vision.snu.ac.kr/projects/jsfusion/>)

Recorded evaluation configuration: {"pooling":"mean"}. This record does not assert independent reproduction.

### Miech et al.

Recall@1: 7.3. Result ID: 698c4fd137894ef7d9cd6c28.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63831e209131ce9ff16c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### JSTmax

Recall@1: 6.7. Result ID: 698c4fd137894ef7d9cd6c2b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Implementation](<http://vision.snu.ac.kr/projects/jsfusion/>)

Recorded evaluation configuration: {"pooling":"max"}. This record does not assert independent reproduction.

### JSFusion-noattention

Recall@1: 6.4. Result ID: 698c4fd137894ef7d9cd6c2d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Implementation](<http://vision.snu.ac.kr/projects/jsfusion/>)

Recorded evaluation configuration: {"attention":false}. This record does not assert independent reproduction.

### EITanque

Recall@1: 4.7. Result ID: 698c4fd137894ef7d9cd6c25.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### JSTfc

Recall@1: 4.7. Result ID: 698c4fd137894ef7d9cd6c29.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Implementation](<http://vision.snu.ac.kr/projects/jsfusion/>)

Recorded evaluation configuration: {"variant":"fc"}. This record does not assert independent reproduction.

### CT-SAN

Recall@1: 4.5. Result ID: 698c4fd137894ef7d9cd6c27.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63811e209131ce9ff019.md>)

[Implementation](<http://vision.snu.ac.kr/projects/lsmdc-2016>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### C+LSTM+SA-FC7

Recall@1: 4.3. Result ID: 698c4fd137894ef7d9cd6c23.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62bc1e209131ce9fafab.md>)

[Implementation](<https://sites.google.com/site/describingmovies>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SNUVL

Recall@1: 3.6. Result ID: 698c4fd137894ef7d9cd6c26.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63811e209131ce9ff019.md>)

[Implementation](<http://vision.snu.ac.kr/projects/lsmdc-2016>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LSTM+SA-FC7

Recall@1: 3.3. Result ID: 698c4fd137894ef7d9cd6c22.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62bc1e209131ce9fafab.md>)

[Implementation](<https://sites.google.com/site/describingmovies>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### VSE-LSTM

Recall@1: 3.1. Result ID: 698c4fd137894ef7d9cd6c24.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa619b1e209131ce9f5136.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LSTM-fusion

Recall@1: 3. Result ID: 698c4fd137894ef7d9cd6c20.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SA-G+SA-FC7

Recall@1: 3. Result ID: 698c4fd137894ef7d9cd6c21.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64a41e209131cea05ce8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62bc1e209131ce9fafab.md>)

[Implementation](<https://sites.google.com/site/describingmovies>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
