# What's Different between Visual Question Answering for Machine "Understanding" Versus for Accessibility?

Source: [What's Different between Visual Question Answering for Machine "Understanding" Versus for Accessibility?](<https://www.sota2.com/research/paper/68fa6dc51e209131cea3c08f>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:43:12.182Z

Authors: Yang Trista Cao, Kyle Seelman, Kyungjun Lee, Hal Daum\\'e III

Published: 2022-10-26T18:23:53.000Z

## Abstract

In visual question answering (VQA), a machine must answer a question given an associated image. Recently, accessibility researchers have explored whether VQA can be deployed in a real-world setting where users with visual impairments learn about their environment by capturing their visual surroundings and asking questions. However, most of the existing benchmarking datasets for VQA focus on machine "understanding" and it remains unclear how progress on those datasets corresponds to improvements in this real-world use case. We aim to answer this question by evaluating discrepancies between machine "understanding" datasets (VQA-v2) and accessibility datasets (VizWiz) by evaluating a variety of VQA models. Based on our findings, we discuss opportunities and challenges in VQA for accessibility and suggest directions for future work.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2210.14966>)

[PDF](<https://arxiv.org/pdf/2210.14966.pdf>)
