# Cross-Modality Multi-Atlas Segmentation via Deep Registration and Label Fusion

Source: [Cross-Modality Multi-Atlas Segmentation via Deep Registration and Label Fusion](<https://www.sota2.com/research/paper/68fa6c1a1e209131cea32370>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:56:52.505Z

Authors: Wangbin Ding, Lei Li, Xiahai Zhuang, Liqin Huang

Published: 2022-02-04T07:10:00.000Z

## Abstract

Multi-atlas segmentation (MAS) is a promising framework for medical image segmentation. Generally, MAS methods register multiple atlases, i.e., medical images with corresponding labels, to a target image; and the transformed atlas labels can be combined to generate target segmentation via label fusion schemes. Many conventional MAS methods employed the atlases from the same modality as the target image. However, the number of atlases with the same modality may be limited or even missing in many clinical applications. Besides, conventional MAS methods suffer from the computational burden of registration or label fusion procedures. In this work, we design a novel cross-modality MAS framework, which uses available atlases from a certain modality to segment a target image from another modality. To boost the computational efficiency of the framework, both the image registration and label fusion are achieved by well-designed deep neural networks. For the atlas-to-target image registration, we propose a bi-directional registration network (BiRegNet), which can efficiently align images from different modalities. For the label fusion, we design a similarity estimation network (SimNet), which estimates the fusion weight of each atlas by measuring its similarity to the target image. SimNet can learn multi-scale information for similarity estimation to improve the performance of label fusion. The proposed framework was evaluated by the left ventricle and liver segmentation tasks on the MM-WHS and CHAOS datasets, respectively. Results have shown that the framework is effective for cross-modality MAS in both registration and label fusion.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Cardiac Segmentation on MM-WHS CT 2-shot (test)](<https://www.sota2.com/research/sota/cardiac-segmentation-on-mm-whs-ct-2-shot-test.md>): Cardiac Segmentation; MM-WHS CT 2-shot (test); Dice (Myocardium): 44.29.

- [Cardiac Segmentation on MM-WHS CT 4-shot (test)](<https://www.sota2.com/research/sota/cardiac-segmentation-on-mm-whs-ct-4-shot-test.md>): Cardiac Segmentation; MM-WHS CT 4-shot (test); Dice (Myocardium): 49.61.

- [Cardiac Segmentation on MM-WHS MRI 2-shot (test)](<https://www.sota2.com/research/sota/cardiac-segmentation-on-mm-whs-mri-2-shot-test.md>): Cardiac Segmentation; MM-WHS MRI 2-shot (test); Dice (Myocardium): 33.74.

- [Cardiac Segmentation on MM-WHS MRI 4-shot (test)](<https://www.sota2.com/research/sota/cardiac-segmentation-on-mm-whs-mri-4-shot-test.md>): Cardiac Segmentation; MM-WHS MRI 4-shot (test); Dice (Myocardium): 47.88.

- [Full heart segmentation on MMWHS-MRI (test)](<https://www.sota2.com/research/sota/full-heart-segmentation-on-mmwhs-mri-test.md>): Full heart segmentation; MMWHS-MRI (test); Myo Dice: 38.28.

- [Full heart segmentation on MMWHS-CT (test)](<https://www.sota2.com/research/sota/full-heart-segmentation-on-mmwhs-ct-test.md>): Full heart segmentation; MMWHS-CT (test); Myo Dice: 51.13.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2202.02000>)

[PDF](<https://arxiv.org/pdf/2202.02000.pdf>)
