# Towards Holistic Surgical Scene Graph

Source: [Towards Holistic Surgical Scene Graph](<https://www.sota2.com/research/paper/68fa7a2a1e209131cea81746>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-02T10:46:12.572Z

Authors: Jongmin Shin, Enki Cho, Ka Young Kim, Jung Yong Kim, Seong Tae Kim, Namkee Oh

Published: 2025-07-21T12:10:42.000Z

## Abstract

Surgical scene understanding is crucial for computer-assisted intervention systems, requiring visual comprehension of surgical scenes that involves diverse elements such as surgical tools, anatomical structures, and their interactions. To effectively represent the complex information in surgical scenes, graph-based approaches have been explored to structurally model surgical entities and their relationships. Previous surgical scene graph studies have demonstrated the feasibility of representing surgical scenes using graphs. However, certain aspects of surgical scenes-such as diverse combinations of tool-action-target and the identity of the hand operating the tool-remain underexplored in graph-based representations, despite their importance. To incorporate these aspects into graph representations, we propose Endoscapes-SG201 dataset, which includes annotations for tool-action-target combinations and hand identity. We also introduce SSG-Com, a graph-based method designed to learn and represent these critical elements. Through experiments on downstream tasks such as critical view of safety assessment and action triplet recognition, we demonstrated the importance of integrating these essential scene graph components, highlighting their significant contribution to surgical scene understanding. The code and dataset are available at https://github.com/ailab-kyunghee/SSG-Com

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Critical View of Safety recognition on EndoScapes-CVS201 (test)](<https://www.sota2.com/research/sota/critical-view-of-safety-recognition-on-endoscapes-cvs201-test.md>): Critical View of Safety recognition; EndoScapes-CVS201 (test); mAP: 64.6.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2507.15541>)

[PDF](<https://arxiv.org/pdf/2507.15541.pdf>)

[Implementation](<https://github.com/ailab-kyunghee/SSG-Com>)