# Learning Accurate Segmentation Purely from Self-Supervision

Source: [Learning Accurate Segmentation Purely from Self-Supervision](<https://www.sota2.com/research/paper/69a5195c2d603e6de3e3c737>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-03T05:00:48.459Z

Authors: Zuyao You, Zuxuan Wu, Yu-Gang Jiang

Published: 2026-02-27T07:36:32.000Z

## Abstract

Accurately segmenting objects without any manual annotations remains one of the core challenges in computer vision. In this work, we introduce Selfment, a fully self-supervised framework that segments foreground objects directly from raw images without human labels, pretrained segmentation models, or any post-processing. Selfment first constructs patch-level affinity graphs from self-supervised features and applies NCut to obtain an initial coarse foreground--background separation. We then introduce Iterative Patch Optimization (IPO), a feature-space refinement procedure that progressively enforces spatial coherence and semantic consistency through iterative patch clustering. The refined masks are subsequently used as supervisory signals to train a lightweight segmentation head with contrastive and region-consistency objectives, allowing the model to learn stable and transferable object representations. Despite its simplicity and complete absence of manual supervision, Selfment sets new state-of-the-art (SoTA) results across multiple benchmarks. It achieves substantial improvements on $F\_{\\max}$ over previous unsupervised saliency detection methods on ECSSD ($+4.0\\%$), HKUIS ($+4.6\\%$), and PASCAL-S ($+5.7\\%$). Moreover, without any additional fine-tuning, Selfment demonstrates remarkable zero-shot generalization to camouflaged object detection tasks (e.g., $0.910$ $S\_m$ on CHAMELEON and $0.792$ $F\_{\\beta}^{\\omega}$ on CAMO), outperforming all existing unsupervised approaches and even rivaling the SoTA fully supervised methods.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2602.23759>)

[PDF](<https://arxiv.org/pdf/2602.23759.pdf>)
