# On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study

Source: [On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study](<https://www.sota2.com/research/paper/68fa70ce1e209131cea4d474>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T01:50:52.513Z

Authors: Liben Chen, Long Chen, Tian Ellison-Chen, Zhuoyuan Xu

Published: 2023-10-04T02:06:48.000Z

## Abstract

Visual Question Answering (VQA) is a challenging task that requires cross-modal understanding and reasoning of visual image and natural language question. To inspect the association of VQA models to human cognition, we designed a survey to record human thinking process and analyzed VQA models by comparing the outputs and attention maps with those of humans. We found that although the VQA models resemble human cognition in architecture and performs similarly with human on the recognition-level, they still struggle with cognitive inferences. The analysis of human thinking procedure serves to direct future research and introduce more cognitive capacity into modeling features and architectures.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2310.02528>)

[PDF](<https://arxiv.org/pdf/2310.02528.pdf>)