# Movie Fill-in-the-Blank on LSMDC 2016 (test) Source: [Movie Fill-in-the-Blank on LSMDC 2016 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:28:39.267Z Evaluation of Movie Fill-in-the-Blank performance on the test split of the LSMDC 2016 dataset, measured using Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Movie Fill-in-the-Blank | | Dataset (including any stated split) | LSMDC 2016 (test) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 34 of 34 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Human | 68.7 | Not recorded | 68fa64a41e209131cea05ce8 | | LAVENDER | 56.9 | Not recorded | 68fa6e4b1e209131cea3f143 | | HiTeA | 54.6 | Not recorded | 68fa6e4b1e209131cea3f143 | | HiTeA | 54.5 | Not recorded | 68fa6e4b1e209131cea3f143 | | Clover | 54.1 | Not recorded | 68fa6e4b1e209131cea3f143 | | VIOLET | 53.7 | Not recorded | 68fa6e4b1e209131cea3f143 | | MERLOT | 52.9 | Not recorded | 68fa6e4b1e209131cea3f143 | | JSFusion | 45.52 | Not recorded | 68fa64a41e209131cea05ce8 | | JSFusion-noaudio | 45.26 | Not recorded | 68fa64a41e209131cea05ce8 | | JSFusion-noattention | 44.5 | Not recorded | 68fa64a41e209131cea05ce8 | | JSTmean | 44.2 | Not recorded | 68fa64a41e209131cea05ce8 | | JSFusion-VGG-noaudio | 44.2 | Not recorded | 68fa64a41e209131cea05ce8 | | JSTlstm | 43.7 | Not recorded | 68fa64a41e209131cea05ce8 | | LR/RL LSTMs | 43.5 | Not recorded | 68fa64a41e209131cea05ce8 | | JSTfc | 42.9 | Not recorded | 68fa64a41e209131cea05ce8 | | CT-SAN | 42.7 | Not recorded | 68fa63811e209131ce9ff019 | | CT-SAN | 41.9 | Not recorded | 68fa63811e209131ce9ff019 | | CT-SAN | 41.9 | Not recorded | 68fa64a41e209131cea05ce8 | | MLB | 41.6 | Not recorded | 68fa64a41e209131cea05ce8 | | JSTmax | 41.3 | Not recorded | 68fa64a41e209131cea05ce8 | | LR/RL LSTMs | 40.9 | Not recorded | 68fa64a41e209131cea05ce8 | | SNUVL | 40.7 | Not recorded | 68fa63811e209131ce9ff019 | | SNUVL | 38 | Not recorded | 68fa63811e209131ce9ff019 | | SNUVL | 38 | Not recorded | 68fa64a41e209131cea05ce8 | | Base-SAN | 36.9 | Not recorded | 68fa63811e209131ce9ff019 | | GoogleNet-2D + C3D | 35.7 | Not recorded | 68fa64a41e209131cea05ce8 | | Base-SAN | 34.5 | Not recorded | 68fa63811e209131ce9ff019 | | Merging-LSTM | 34.2 | Not recorded | 68fa63811e209131ce9ff019 | | Merging-LSTM | 34.2 | Not recorded | 68fa64a41e209131cea05ce8 | | Ask Your Neurons | 33.2 | Not recorded | 68fa64a41e209131cea05ce8 | | Text-only BLSTM | 32 | Not recorded | 68fa64a41e209131cea05ce8 | | Simple-BLSTM | 31.6 | Not recorded | 68fa63811e209131ce9ff019 | | Simple-LSTM | 30.9 | Not recorded | 68fa63811e209131ce9ff019 | | Text-only Human | 30.2 | Not recorded | 68fa64a41e209131cea05ce8 | ### Human Accuracy: 68.7. Result ID: 698c4fd137894ef7d9cd6c1f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LAVENDER Accuracy: 56.9. Result ID: 69900d483a6c314849fdc45c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"#PT Data":"5M"}. This record does not assert independent reproduction. ### HiTeA Accuracy: 54.6. Result ID: 69900d483a6c314849fdc460. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"#PT Data":"5M"}. This record does not assert independent reproduction. ### HiTeA Accuracy: 54.5. Result ID: 69900d483a6c314849fdc461. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"#PT Data":"17M"}. This record does not assert independent reproduction. ### Clover Accuracy: 54.1. Result ID: 69900d483a6c314849fdc45d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"#PT Data":"5M"}. This record does not assert independent reproduction. ### VIOLET Accuracy: 53.7. Result ID: 69900d483a6c314849fdc45e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"#PT Data":"183M"}. This record does not assert independent reproduction. ### MERLOT Accuracy: 52.9. Result ID: 69900d483a6c314849fdc45f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"#PT Data":"180M"}. This record does not assert independent reproduction. ### JSFusion Accuracy: 45.52. Result ID: 698c4fd137894ef7d9cd6c1e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### JSFusion-noaudio Accuracy: 45.26. Result ID: 698c4fd137894ef7d9cd6c1d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Audio":false}. This record does not assert independent reproduction. ### JSFusion-noattention Accuracy: 44.5. Result ID: 698c4fd137894ef7d9cd6c1b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Attention":false}. This record does not assert independent reproduction. ### JSTmean Accuracy: 44.2. Result ID: 698c4fd137894ef7d9cd6c1a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Fusion":"mean"}. This record does not assert independent reproduction. ### JSFusion-VGG-noaudio Accuracy: 44.2. Result ID: 698c4fd137894ef7d9cd6c1c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"VGG","Audio":false}. This record does not assert independent reproduction. ### JSTlstm Accuracy: 43.7. Result ID: 698c4fd137894ef7d9cd6c18. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Fusion":"lstm"}. This record does not assert independent reproduction. ### LR/RL LSTMs Accuracy: 43.5. Result ID: 698c4fd137894ef7d9cd6c15. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Ensemble":true}. This record does not assert independent reproduction. ### JSTfc Accuracy: 42.9. Result ID: 698c4fd137894ef7d9cd6c17. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Fusion":"fc"}. This record does not assert independent reproduction. ### CT-SAN Accuracy: 42.7. Result ID: 698bf64bf729bc7f68e6e9b3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Configuration":"Ensemble"}. This record does not assert independent reproduction. ### CT-SAN Accuracy: 41.9. Result ID: 698bf64bf729bc7f68e6e9b2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Configuration":"Single"}. This record does not assert independent reproduction. ### CT-SAN Accuracy: 41.9. Result ID: 698c4fd137894ef7d9cd6c13. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MLB Accuracy: 41.6. Result ID: 698c4fd137894ef7d9cd6c16. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### JSTmax Accuracy: 41.3. Result ID: 698c4fd137894ef7d9cd6c19. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Fusion":"max"}. This record does not assert independent reproduction. ### LR/RL LSTMs Accuracy: 40.9. Result ID: 698c4fd137894ef7d9cd6c14. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SNUVL Accuracy: 40.7. Result ID: 698bf64bf729bc7f68e6e9b1. [Reporting paper]() Recorded evaluation configuration: {"Model Configuration":"Ensemble"}. This record does not assert independent reproduction. ### SNUVL Accuracy: 38. Result ID: 698bf64bf729bc7f68e6e9b0. [Reporting paper]() Recorded evaluation configuration: {"Model Configuration":"Single"}. This record does not assert independent reproduction. ### SNUVL Accuracy: 38. Result ID: 698c4fd137894ef7d9cd6c12. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Base-SAN Accuracy: 36.9. Result ID: 698bf64bf729bc7f68e6e9af. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Configuration":"Ensemble"}. This record does not assert independent reproduction. ### GoogleNet-2D + C3D Accuracy: 35.7. Result ID: 698c4fd137894ef7d9cd6c0f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GoogleNet-2D + C3D"}. This record does not assert independent reproduction. ### Base-SAN Accuracy: 34.5. Result ID: 698bf64bf729bc7f68e6e9ad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Configuration":"Single"}. This record does not assert independent reproduction. ### Merging-LSTM Accuracy: 34.2. Result ID: 698bf64bf729bc7f68e6e9ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Merging-LSTM Accuracy: 34.2. Result ID: 698c4fd137894ef7d9cd6c11. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Ask Your Neurons Accuracy: 33.2. Result ID: 698c4fd137894ef7d9cd6c10. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Text-only BLSTM Accuracy: 32. Result ID: 698c4fd137894ef7d9cd6c0d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input":"Text-only"}. This record does not assert independent reproduction. ### Simple-BLSTM Accuracy: 31.6. Result ID: 698bf64bf729bc7f68e6e9ac. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Simple-LSTM Accuracy: 30.9. Result ID: 698bf64bf729bc7f68e6e9ab. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Text-only Human Accuracy: 30.2. Result ID: 698c4fd137894ef7d9cd6c0e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input":"Text-only"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.