MovieQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MovieQA (val)
0.447Accuracy
13
MovieQA (val)
53.44Accuracy (V+S)
8
MovieQA v1 (test)
36.25Accuracy
8
MovieQA v1 (val)
38.67Accuracy
8
MovieQA (val)
41Accuracy
7
MovieQA Plot Synopses 1.0 (test)
77.6Accuracy
7
MovieQA (test)
42.53Accuracy
6
MovieQA Plot Synopses 1.0 (val)
72.1Accuracy
6
MovieQA DVS 1.0 (val)
40Accuracy
5
MovieQA Script 1.0 (val)
44Accuracy
5
MovieQA Subtitle 1.0 (val)
40.4Accuracy
5
MovieQA DVS 1.0 (test)
35Accuracy
4
MovieQA Script 1.0 (test)
39.4Accuracy
4
MovieQA Subtitle 1.0 (test)
38.5Accuracy
4
MovieQA (test)
37.3Accuracy
3
MovieQA Open-end 1.0 (test)
36.6Accuracy
2