VQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VQA 1.0 (test-dev)
67.42Overall Accuracy
44
VQA v2
100ASR
42
VQA v2 (test val)
78.5Accuracy
38
VQA v2 (test)
55AP
38
VQA v2
74.5Accuracy (Clean)
37
VQA v2
79.01Accuracy
36
VQAv2
54.1Accuracy
36
VQA v2
81.3Accuracy
35
VQA v2
78.5VQA-2 Score
34
VQA v2
1.13Positive Perturbation AUC
34
VQA hard criterion
82ASR
32
VQA (test-standard)
83.3Accuracy (Overall)
32
VQA v2 (std)
84.3Accuracy
31
VQA v2
0.77Refusal Rate
30
VQA 10,000 samples v2 (val)
74.66Accuracy (VQA)
30
VQA v2 (dev)
84.3Accuracy
30
VQA v2
83.5Accuracy
28
VQA 1 (test-standard)
83.3VQA Open-Ended Accuracy (All)
28
VQA v2
0.777ROC
27
VQA 1.0 (test-standard)
69.97Accuracy (All)
27
VQA v2
78.5Accuracy
26
VQA v2
78.5Accuracy
25
VQA v1
83.2Accuracy
25
VQA 2.0 (test)
80.2Accuracy
24
VQA v2.0 47 (val)
87Accuracy
23