OKVQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
OKVQA
75.29Top-1 Accuracy
283
OKVQA
0.885Accuracy
101
OKVQA (val)
66.1VQA Score
101
OKVQA
79.9AUROC
62
OKVQA
100ASR
42
OKVQA
59.57VQA Accuracy
34
OKVQA
64.56Accuracy
34
OKVQA
73.07ASR (Success Rate)
30
OKVQA (val)
66.7Accuracy
27
OKVQA (test)
64.3Accuracy
18
OKVQA Google Search (test)
84.66PR@5
16
OKVQA
61.92Score
16
OKVQA
0.761AUROC
14
OKVQA
60.3VQA Accuracy (Clean)
14
OKVQA
60.13Accuracy
14
OKVQA (test)
65.7Accuracy
11
OKVQA (I) (test)
57.8VQA Accuracy
11
OKVQA N=200
61.7Score D
11
OKVQA (N=100)
56.6CD Score
11
OKVQA N=40
48.8CD
11
OKVQA POPE Popular
85Accuracy
11
OKVQA
57.79Score
10
OKVQA
60.2OKVQA Score
9
OKVQA
0.788AUROC
9
OKVQA
64.56Score
9