# Multi-modal Representations for Fine-grained Multi-label Critical View of Safety Recognition

Source: [Multi-modal Representations for Fine-grained Multi-label Critical View of Safety Recognition](<https://www.sota2.com/research/paper/68fa79ed1e209131cea8001e>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-02T13:39:43.478Z

Authors: Britty Baby, Vinkle Srivastav, Pooja P. Jain, Kun Yuan, Pietro Mascagni, Nicolas Padoy

Published: 2025-07-07T13:44:58.000Z

## Abstract

The Critical View of Safety (CVS) is crucial for safe laparoscopic cholecystectomy, yet assessing CVS criteria remains a complex and challenging task, even for experts. Traditional models for CVS recognition depend on vision-only models learning with costly, labor-intensive spatial annotations. This study investigates how text can be harnessed as a powerful tool for both training and inference in multi-modal surgical foundation models to automate CVS recognition. Unlike many existing multi-modal models, which are primarily adapted for multi-class classification, CVS recognition requires a multi-label framework. Zero-shot evaluation of existing multi-modal surgical models shows a significant performance gap for this task. To address this, we propose CVS-AdaptNet, a multi-label adaptation strategy that enhances fine-grained, binary classification across multiple labels by aligning image embeddings with textual descriptions of each CVS criterion using positive and negative prompts. By adapting PeskaVLP, a state-of-the-art surgical foundation model, on the Endoscapes-CVS201 dataset, CVS-AdaptNet achieves 57.6 mAP, improving over the ResNet50 image-only baseline (51.5 mAP) by 6 points. Our results show that CVS-AdaptNet's multi-label, multi-modal framework, enhanced by textual prompts, boosts CVS recognition over image-only methods. We also propose text-specific inference methods, that helps in analysing the image-text alignment. While further work is needed to match state-of-the-art spatial annotation-based methods, this approach highlights the potential of adapting generalist models to specialized surgical tasks. Code: https://github.com/CAMMA-public/CVS-AdaptNet

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Critical View of Safety recognition on EndoScapes-CVS201 (test)](<https://www.sota2.com/research/sota/critical-view-of-safety-recognition-on-endoscapes-cvs201-test.md>): Critical View of Safety recognition; EndoScapes-CVS201 (test); mAP: 57.6.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2507.05007>)

[PDF](<https://arxiv.org/pdf/2507.05007.pdf>)

[Implementation](<https://github.com/CAMMA-public/CVS-AdaptNet>)
