# Exploring The Spatial Reasoning Ability of Neural Models in Human IQ Tests

Source: [Exploring The Spatial Reasoning Ability of Neural Models in Human IQ Tests](<https://www.sota2.com/research/paper/68fa6a8d1e209131cea28c15>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:09:35.928Z

Authors: Hyunjae Kim, Yookyung Koh, Jinheon Baek, Jaewoo Kang

Published: 2020-04-11T09:41:46.000Z

## Abstract

Although neural models have performed impressively well on various tasks such as image recognition and question answering, their reasoning ability has been measured in only few studies. In this work, we focus on spatial reasoning and explore the spatial understanding of neural models. First, we describe the following two spatial reasoning IQ tests: rotation and shape composition. Using well-defined rules, we constructed datasets that consist of various complexity levels. We designed a variety of experiments in terms of generalization, and evaluated six different baseline models on the newly generated datasets. We provide an analysis of the results and factors that affect the generalization abilities of models. Also, we analyze how neural models solve spatial reasoning tests with visual aids. Our findings would provide valuable insights into understanding a machine and the difference between a machine and human.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2004.05352>)

[PDF](<https://arxiv.org/pdf/2004.05352.pdf>)
