OK-VQA
Benchmarks
TaskDatasetSOTA resultTrendResults
OK-VQA
84.7Accuracy
331
OK-VQA (test)
76.5Accuracy
327
OK-VQA v1.0 (test)
85.6Accuracy
82
OK-VQA
91.9Accuracy
49
OK-VQA (val)
66.8Accuracy
47
OK-VQA
68.6VQA Score
41
OK-VQA v1.1 (test)
66.1VQA Score
28
OK-VQA
44.29EM
24
OK-VQA standard (test)
66.1VQA Accuracy
19
OK-VQA full (val)
62.24Accuracy
18
OK-VQA
80.7VQA Score
18
OK-VQA v1.0 (test)
61.2Accuracy
15
OK-VQA
58.2Score
14
OK-VQA full v1.0 (val)
59.56VQA Accuracy
12
OK-VQA 2019
57.3V-Score
12
OK-VQA Speech-converted
29.04Accuracy
12
OK-VQA (test)
59.3cMAP
10
OK-VQA
59.3cMAP
10
OK-VQA v1.1 (test)
89.32Recall@5
10
OK-VQA (test)
88PRR@5
7
OK-VQA Far OOD
50.11Accuracy
6
OK-VQA (test)
0.4CIDEr
6
OK-VQA
90.47Pseudo Recall@5
6
OK-VQA OOD 5k
60.23VQA Score
5
OK-VQA Non-IID
46.06Accuracy
5