# OMH: Structured Sparsity via Optimally Matched Hierarchy for Unsupervised Semantic Segmentation

Source: [OMH: Structured Sparsity via Optimally Matched Hierarchy for Unsupervised Semantic Segmentation](<https://www.sota2.com/research/paper/68fa72d41e209131cea58c33>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:35:49.064Z

Authors: Baran Ozaydin, Tong Zhang, Deblina Bhattacharjee, Sabine S\\"usstrunk, Mathieu Salzmann

Published: 2024-03-11T09:46:41.000Z

## Abstract

Unsupervised Semantic Segmentation (USS) involves segmenting images without relying on predefined labels, aiming to alleviate the burden of extensive human labeling. Existing methods utilize features generated by self-supervised models and specific priors for clustering. However, their clustering objectives are not involved in the optimization of the features during training. Additionally, due to the lack of clear class definitions in USS, the resulting segments may not align well with the clustering objective. In this paper, we introduce a novel approach called Optimally Matched Hierarchy (OMH) to simultaneously address the above issues. The core of our method lies in imposing structured sparsity on the feature space, which allows the features to encode information with different levels of granularity. The structure of this sparsity stems from our hierarchy (OMH). To achieve this, we learn a soft but sparse hierarchy among parallel clusters through Optimal Transport. Our OMH yields better unsupervised segmentation performance compared to existing USS methods. Our extensive experiments demonstrate the benefits of OMH when utilizing our differentiable paradigm. We will make our code publicly available.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2403.06546>)

[PDF](<https://arxiv.org/pdf/2403.06546.pdf>)