# Assessing Multimodal Chronic Wound Embeddings with Expert Triplet Agreement

Source: [Assessing Multimodal Chronic Wound Embeddings with Expert Triplet Agreement](<https://www.sota2.com/research/paper/69cca6c10636e5bf4afcbd74>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-04T05:00:04.515Z

Authors: Fabian Kabus, Julia Hindel, Jelena Bratuli\\'c, Meropi Karakioulaki, Ayush Gupta, Cristina Has, Thomas Brox, Abhinav Valada, Harald Binder

Published: 2026-03-31T07:46:02.000Z

## Abstract

Recessive dystrophic epidermolysis bullosa (RDEB) is a rare genetic skin disorder for which clinicians greatly benefit from finding similar cases using images and clinical text. However, off-the-shelf foundation models do not reliably capture clinically meaningful features for this heterogeneous, long-tail disease, and structured measurement of agreement with experts is challenging. To address these gaps, we propose evaluating embedding spaces with expert ordinal comparisons (triplet judgments), which are fast to collect and encode implicit clinical similarity knowledge. We further introduce TriDerm, a multimodal framework that learns interpretable wound representations from small cohorts by integrating wound imagery, boundary masks, and expert reports. On the vision side, TriDerm adapts visual foundation models to RDEB using wound-level attention pooling and non-contrastive representation learning. For text, we prompt large language models with comparison queries and recover medically meaningful representations via soft ordinal embeddings (SOE). We show that visual and textual modalities capture complementary aspects of wound phenotype, and that fusing both modalities yields 73.5% agreement with experts, outperforming the best off-the-shelf single-modality foundation model by over 5.6 percentage points. We make the expert annotation tool, model code and representative dataset samples publicly available.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Expert Triplet Agreement on Chronic Wound Expert Triplet Dataset (test)](<https://www.sota2.com/research/sota/expert-triplet-agreement-on-chronic-wound-expert-triplet-dataset-test.md>): Expert Triplet Agreement; Chronic Wound Expert Triplet Dataset (test); Balanced Anchor Agreement: 73.5.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2603.29376>)

[PDF](<https://arxiv.org/pdf/2603.29376.pdf>)
