VQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VQA v2 (train)
78.9Accuracy
23
VQA v2
78.53Accuracy
22
VQA v2
81.8Accuracy
22
VQA v2
78.5Accuracy
22
VQA Karpathy (test)
77.9Overall Accuracy
21
VQAv2 (val)
75.33Accuracy (Overall)
21
VQA (test)
77.8BS Score
20
VQA v2
78.5Absolute Score
20
VQA v2
78.9Score
20
VQA v2 (Novel Compositional Test)
44.96AP
20
VQA Standard v2 (test)
45.41AP
20
VQAv2 (dev)
84.19Accuracy
19
VQAv2 (first quarter)
80Score
18
VQA v2
74.5Accuracy (Clean)
18
VQA (Specific)
99.4Targeted ASR
18
VQA dataset
38.2Step Completion
18
VQA + AdVQA 50/50 mix v2 (test)
63.02Accuracy
17
Mixed ID/OOD 66.7% VQA v2 / 33.3% AdVQA (test)
67.79Acc
17
VQA (test-dev)
69.4Overall Accuracy
17
VQA (test-standard)
70.1Accuracy (All)
17
VQA v2
79.2VQAv2 Score
16
VQA v2 (test)
89.6Classification Accuracy
16
VQA Irrel. v2
87ASR
16
VQA Sim. v2
96ASR
16
VQA Exact v2
98.8ASR
16