VQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VQA v2
81.2Accuracy
16
VQA COCO 2015 v1.0 (test-dev)
62.48Overall Accuracy
16
VQAv2 18
82.4Accuracy
15
VQA v2
0.883AUROC
14
VQA-CE Easy
80.5Accuracy
14
VQA 5 tasks
62.14Accuracy (%)
14
VQA V2
53.31Accuracy (1-Shot)
14
VQA Aggregated Subsets
100Average Ratio
13
VQA 10% subset
52.14Accuracy
13
VQA v2
82.8Accuracy
12
VQA v2
90Robust Accuracy
12
VQA Speech-converted v2
32.95Accuracy
12
VQA Mean
92Closed Accuracy
11
VQA (VQA-v2, GQA, VizWiz, TextVQA, POPE, TallyQA)
66.42VQA-v2 Accuracy
11
VQA Easy examples v1 (val)
79.02Accuracy
11
VQA Counterexamples v1 (val)
32.8Accuracy
11
VQA v2
82.3Accuracy
10
VQAv2 3K curated MS COCO (test)
7.4Relative Performance Drop (%)
10
Text-rich VQA
80.1Score
10
VQA v2
55.18ASR
10
VQA Adversarial, epsilon_a = 4/255 v2
42.6VQA Accuracy
10
VQA Clean v2 (test)
74.5Accuracy (VQA)
10
VQA (dev)
75.9Accuracy
10
VQA (test-dev)
70.2Accuracy (All)
10
VQA v2
82.6VQA v2 Accuracy
9