# Visual attention analysis of pathologists examining whole slide images of Prostate cancer

Source: [Visual attention analysis of pathologists examining whole slide images of Prostate cancer](<https://www.sota2.com/research/paper/68fa6c7d1e209131cea3443c>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:14:32.298Z

Authors: Souradeep Chakraborty, Ke Ma, Rajarsi Gupta, Beatrice Knudsen, Gregory J. Zelinsky, Joel H. Saltz, Dimitris Samaras

Published: 2022-02-17T04:01:43.000Z

## Abstract

We study the attention of pathologists as they examine whole-slide images (WSIs) of prostate cancer tissue using a digital microscope. To the best of our knowledge, our study is the first to report in detail how pathologists navigate WSIs of prostate cancer as they accumulate information for their diagnoses. We collected slide navigation data (i.e., viewport location, magnification level, and time) from 13 pathologists in 2 groups (5 genitourinary (GU) specialists and 8 general pathologists) and generated visual attention heatmaps and scanpaths. Each pathologist examined five WSIs from the TCGA PRAD dataset, which were selected by a GU pathology specialist. We examined and analyzed the distributions of visual attention for each group of pathologists after each WSI was examined. To quantify the relationship between a pathologist's attention and evidence for cancer in the WSI, we obtained tumor annotations from a genitourinary specialist. We used these annotations to compute the overlap between the distribution of visual attention and annotated tumor region to identify strong correlations. Motivated by this analysis, we trained a deep learning model to predict visual attention on unseen WSIs. We find that the attention heatmaps predicted by our model correlate quite well with the ground truth attention heatmap and tumor annotations on a test set of 17 WSIs by using various spatial and temporal evaluation metrics.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Attention Heatmap Prediction on TCGA-PRAD (Prostate Cancer) H&E WSIs (test)](<https://www.sota2.com/research/sota/attention-heatmap-prediction-on-tcga-prad-prostate-cancer-h-and-e-wsis-test.md>): Attention Heatmap Prediction; TCGA-PRAD (Prostate Cancer) H&E WSIs (test); CC Attn: 0.262.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2202.08437>)

[PDF](<https://arxiv.org/pdf/2202.08437.pdf>)