# Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

Source: [Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling](<https://www.sota2.com/research/paper/68fa68461e209131cea1afcb>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:33:00.328Z

Authors: Haochuan Jiang, Chengjia Wang, Agisilaos Chartsias, Sotirios A. Tsaftaris

Published: 2020-09-05T17:24:23.000Z

## Abstract

Automatic segmentation of multi-sequence (multi-modal) cardiac MR (CMR) images plays a significant role in diagnosis and management for a variety of cardiac diseases. However, the performance of relevant algorithms is significantly affected by the proper fusion of the multi-modal information. Furthermore, particular diseases, such as myocardial infarction, display irregular shapes on images and occupy small regions at random locations. These facts make pathology segmentation of multi-modal CMR images a challenging task. In this paper, we present the Max-Fusion U-Net that achieves improved pathology segmentation performance given aligned multi-modal images of LGE, T2-weighted, and bSSFP modalities. Specifically, modality-specific features are extracted by dedicated encoders. Then they are fused with the pixel-wise maximum operator. Together with the corresponding encoding features, these representations are propagated to decoding layers with U-Net skip-connections. Furthermore, a spatial-attention module is applied in the last decoding layer to encourage the network to focus on those small semantically meaningful pathological regions that trigger relatively high responses by the network neurons. We also use a simple image patch extraction strategy to dynamically resample training examples with varying spacial and batch sizes. With limited GPU memory, this strategy reduces the imbalance of classes and forces the model to focus on regions around the interested pathology. It further improves segmentation accuracy and reduces the mis-classification of pathology. We evaluate our methods using the Myocardial pathology segmentation (MyoPS) combining the multi-sequence CMR dataset which involves three modalities. Extensive experiments demonstrate the effectiveness of the proposed model which outperforms the related baselines.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Myocardial lesion segmentation on Myocardial lesion segmentation dataset](<https://www.sota2.com/research/sota/myocardial-lesion-segmentation-on-myocardial-lesion-segmentation-dataset.md>): Myocardial lesion segmentation; Myocardial lesion segmentation dataset; Dice (Myo): 74.84.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2009.02569>)

[PDF](<https://arxiv.org/pdf/2009.02569.pdf>)
