# Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Development

Source: [Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Development](<https://www.sota2.com/research/paper/68fa68811e209131cea1c7f4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:38:59.898Z

Authors: Alexandros Karargyris, Satyananda Kashyap, Ismini Lourentzou, Joy Wu, Arjun Sharma, Matthew Tong, Shafiq Abedin, David Beymer, Vandana Mukherjee, Elizabeth A Krupinski, Mehdi Moradi

Published: 2020-09-15T23:12:49.000Z

## Abstract

We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset contains the following aligned data: CXR image, transcribed radiology report text, radiologist's dictation audio and eye gaze coordinates data. We hope this dataset can contribute to various areas of research particularly towards explainable and multimodal deep learning / machine learning methods. Furthermore, investigators in disease classification and localization, automated radiology report generation, and human-machine interaction can benefit from these data. We report deep learning experiments that utilize the attention maps produced by eye gaze dataset to show the potential utility of this data.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Classification on SIIM-ACR official (test)](<https://www.sota2.com/research/sota/classification-on-siim-acr-official-test.md>): Classification; SIIM-ACR official (test); Accuracy: 81.1.

- [Classification on CXR-Gaze official (test)](<https://www.sota2.com/research/sota/classification-on-cxr-gaze-official-test.md>): Classification; CXR-Gaze official (test); AUC: 87.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2009.07386>)

[PDF](<https://arxiv.org/pdf/2009.07386.pdf>)
