# Unifying Global-Local Representations in Salient Object Detection with Transformer

Source: [Unifying Global-Local Representations in Salient Object Detection with Transformer](<https://www.sota2.com/research/paper/68fa728e1e209131cea57085>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:28:52.799Z

Authors: Sucheng Ren, Qiang Wen, Nanxuan Zhao, Guoqiang Han, Shengfeng He

Published: 2021-08-05T17:51:32.000Z

## Abstract

The fully convolutional network (FCN) has dominated salient object detection for a long period. However, the locality of CNN requires the model deep enough to have a global receptive field and such a deep model always leads to the loss of local details. In this paper, we introduce a new attention-based encoder, vision transformer, into salient object detection to ensure the globalization of the representations from shallow to deep layers. With the global view in very shallow layers, the transformer encoder preserves more local representations to recover the spatial details in final saliency maps. Besides, as each layer can capture a global view of its previous layer, adjacent layers can implicitly maximize the representation differences and minimize the redundant features, making that every output feature of transformer layers contributes uniquely for final prediction. To decode features from the transformer, we propose a simple yet effective deeply-transformed decoder. The decoder densely decodes and upsamples the transformer features, generating the final saliency map with less noise injection. Experimental results demonstrate that our method significantly outperforms other FCN-based and transformer-based methods in five benchmarks by a large margin, with an average of 12.17% improvement in terms of Mean Absolute Error (MAE). Code will be available at https://github.com/OliverRensu/GLSTR.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Salient Object Detection on DUTS](<https://www.sota2.com/research/sota/salient-object-detection-on-duts.md>): Salient Object Detection; DUTS; F-beta Score: 95.3.

- [Salient Object Detection on PASCAL-S](<https://www.sota2.com/research/sota/salient-object-detection-on-pascal-s.md>): Salient Object Detection; PASCAL-S; MAE: 0.054.

- [Salient Object Detection on ECSSD](<https://www.sota2.com/research/sota/salient-object-detection-on-ecssd.md>): Salient Object Detection; ECSSD; MAE: 0.029.

- [Salient Object Detection on HKU-IS](<https://www.sota2.com/research/sota/salient-object-detection-on-hku-is.md>): Salient Object Detection; HKU-IS; MAE: 0.026.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2108.02759>)

[PDF](<https://arxiv.org/pdf/2108.02759.pdf>)
