GQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GQA Popular split
86.07Accuracy
31
GQA v1.0 (test)
63.3Accuracy
31
GQA-200 (test)
29.4R@50
31
GQA
77Refusal Rate
30
GQA
65.4Accuracy
30
GQA
63.9Accuracy
29
GQA v1.2 (test)
61.9GQA Score
28
GQA
6.09ECE
27
GQA
60.3Clean Accuracy
27
GQA
61.9GQA Score
26
GQA
61.9Accuracy
26
GQA
64.2Accuracy
25
GQA 40 (test)
36.4TTFT (s)
25
GQA (test val)
61.9Accuracy
25
GQA (test)
69Accuracy
24
GQA
61.9Accuracy
23
GQA
61.9GQA Score
22
GQA
61.37Accuracy
22
GQA
62.4Accuracy
21
GQA
64.2Accuracy (GQA)
21
GQA
64.2GQA Score
20
GQA
66.4Score
20
GQA OOD (test)
57.5Accuracy
20
GQA
61.94GQA Score
19
GQA
61.9Accuracy
19