RIO-Bench
Benchmarks
TaskDatasetSOTA resultTrendResults
RIO-Bench Text-VQA (OE) Attack
85.3Acc (AVG)
40
RIO-Bench Text-VQA (OE) Clean
84.6Accuracy
40
RIO-Bench Obj-VQA (MC) (Attack)
99Accuracy (Average)
40
RIO-Bench Obj-VQA (MC) Clean
98.4Accuracy
40
RIO-Bench Obj-VQA (OE) Attack
60.1Accuracy (Easy)
24
RIO-Bench Obj-VQA (OE) Clean
62.2Accuracy
24
RIO-Bench Overall Average
71.69Accuracy
14
RIO-Bench Hard
65.92Accuracy
14
RIO-Bench Medium
73.34Accuracy
14
RIO-Bench Easy
75.81Accuracy
14