VQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VQA 100 prompts
52.54Accuracy
4
VQA-T
64.84Accuracy
4
VQA v2
8.7GFLOPs
4
VQA Open-ended
78.3In-D Acc
4
VQAv2 Synergy synthetic (val)
70.08Accuracy
3
VQA v2 (held-out)
59.95Accuracy (Typical)
3
VQA v2
78.53Accuracy
3
VQA v2 (test-dev)
71.1Accuracy (Noise)
2
VQA v2
60.6Accuracy (Noise)
2
VQA v2
54.63Exact Match
2
VQA v2.0
57.03Overall Accuracy
2
VQA v2
22Runtime (hours)
2
VQA (test)
55.1Accuracy (All)
2
VQAv2 Reliable Challenge (test-dev)
83.99Accuracy
1
VQA v2
78.2Baseline Perf.
1
VQA-X
43.9Preference Rate (Ours)
1