POPE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
POPE
94.42Accuracy
2,056
POPE Popular
93.33Accuracy
406
POPE Adversarial
90Accuracy
367
POPE (Random)
93.02F1 Score
338
POPE
94.42Accuracy
281
POPE
92Accuracy
259
POPE Adversarial
89.8Accuracy
174
POPE Random
94Accuracy
152
POPE
87.6Accuracy (POPE)
137
POPE
89.6Accuracy
136
POPE (test)
90.6Accuracy
123
POPE
0.906POPE Score
116
POPE MSCOCO
93.97F1 Score
114
POPE (popular)
92Accuracy
100
POPE GQA
91.03Accuracy
86
POPE Adversarial offline
68.96F1 Score
84
POPE Popular offline
84.43F1 Score
84
POPE Random offline
73.6F1 Score
84
POPE A-OKVQA
91.2Accuracy
83
POPE
91.9F1 Score
79
POPE GQA Popular
89.4Accuracy
70
POPE (test)
0.248CAE
69
POPE
100.43Average Accuracy
53
POPE Average
87.84Accuracy
52
POPE Random, Popular, Adversarial v1.0
94.27Random Score
51