VQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VQA
42.1Step Completion Rate
9
VQA (std)
76.1Accuracy
9
VQA v2
76.7Accuracy (VQA v2)
8
VQA v2
75.62Accuracy
8
VQA v2
82.7Exact Match Accuracy
8
VQA v2
67.89Accuracy
8
VQA 1.0
65.1BLEU-1
8
VQA (test-dev)
81.1Yes/No Accuracy
8
VQA RoboSpatial ERQA EO Bench
46.7ERQA
7
VQA In-distribution v2.0
73.8Accuracy
7
VQA v2 (subject 1)
56.95Accuracy
7
VQAv2
80.8VQAv2 Score
7
VQA
0.95Relative Performance Drop
7
VQA Average (VQAv2, OK-VQA, GQA)
66.9Accuracy (Clean)
7
VQA 2019 (test)
79.87Overall Accuracy
7
VQA loc v2.0 (val)
67.33Accuracy
7
VQA Count-QA
1.8mRMSE
7
VQA v2
89.2AUROC
6
VQA v2
33.5C2%
6
VQA
8.3Inference Time (s)
6
VQA v2
81.2VQA Score
6
VQA cross-domain 2019
77Accuracy
6
VQA AttackVLM (test)
87.9FCS
6
VQA FOA (test)
0.88FCS Score
6
VQA M-Attack (test)
92.5FCS
6