Movie Fill-in-the-Blank on LSMDC 2016 (test)
68.7AccuracyHuman
Evaluation Results
| Method | Links | |
|---|---|---|
| Human2018.08 | 68.7 | |
| LAVENDER#PT Data=5M2022.12 | 56.9 | |
| HiTeA#PT Data=5M2022.12 | 54.6 | |
| HiTeA#PT Data=17M2022.12 | 54.5 | |
| Clover#PT Data=5M2022.12 | 54.1 | |
| VIOLET#PT Data=183M2022.12 | 53.7 | |
| MERLOT#PT Data=180M2022.12 | 52.9 | |
| JSFusion2018.08 | 45.52 | |
| JSFusion-noaudioAudio=false2018.08 | 45.26 | |
| JSFusion-noattentionAttention=false2018.08 | 44.5 | |
| JSTmeanFusion=mean2018.08 | 44.2 | |
| JSFusion-VGG-noaudioBackbone=VGG, Audio=false2018.08 | 44.2 | |
| JSTlstmFusion=lstm2018.08 | 43.7 | |
| LR/RL LSTMsEnsemble=true2018.08 | 43.5 | |
| JSTfcFusion=fc2018.08 | 42.9 | |
| CT-SANModel Configuration=Ensemble2016.10 | 42.7 | |
| CT-SANModel Configuration=Single2016.10 | 41.9 | |
| CT-SAN2018.08 | 41.9 | |
| MLB2018.08 | 41.6 | |
| JSTmaxFusion=max2018.08 | 41.3 | |
| LR/RL LSTMs2018.08 | 40.9 | |
| SNUVLModel Configuration=Ensemble2016.10 | 40.7 | |
| SNUVLModel Configuration=Single2016.10 | 38 | |
| SNUVL2018.08 | 38 | |
| Base-SANModel Configuration=Ensemble2016.10 | 36.9 | |
| GoogleNet-2D + C3DBackbone=GoogleNet-2D + C3D2018.08 | 35.7 | |
| Base-SANModel Configuration=Single2016.10 | 34.5 | |
| Merging-LSTM2016.10 | 34.2 | |
| Merging-LSTM2018.08 | 34.2 | |
| Ask Your Neurons2018.08 | 33.2 | |
| Text-only BLSTMInput=Text-only2018.08 | 32 | |
| Simple-BLSTM2016.10 | 31.6 | |
| Simple-LSTM2016.10 | 30.9 | |
| Text-only HumanInput=Text-only2018.08 | 30.2 |