# Hard to Cheat: A Turing Test based on Answering Questions about Images

Source: [Hard to Cheat: A Turing Test based on Answering Questions about Images](<https://www.sota2.com/research/paper/68fa61b31e209131ce9f5766>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T05:49:55.019Z

Authors: Mateusz Malinowski, Mario Fritz

Published: 2015-01-14T10:38:43.000Z

## Abstract

Progress in language and image understanding by machines has sparkled the interest of the research community in more open-ended, holistic tasks, and refueled an old AI dream of building intelligent machines. We discuss a few prominent challenges that characterize such holistic tasks and argue for "question answering about images" as a particular appealing instance of such a holistic task. In particular, we point out that it is a version of a Turing Test that is likely to be more robust to over-interpretations and contrast it with tasks like grounding and generation of descriptions. Finally, we discuss tools to measure progress in this field.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1501.03302>)

[PDF](<https://arxiv.org/pdf/1501.03302.pdf>)
