# Hypercolumns for Object Segmentation and Fine-grained Localization

Source: [Hypercolumns for Object Segmentation and Fine-grained Localization](<https://www.sota2.com/research/paper/68fa61ce1e209131ce9f6177>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T20:06:28.249Z

Authors: Bharath Hariharan, Pablo Arbel\\'aez, Ross Girshick, Jitendra Malik

Published: 2014-11-21T03:12:33.000Z

## Abstract

Recognition algorithms based on convolutional networks (CNNs) typically use the output of the last layer as feature representation. However, the information in this layer may be too coarse to allow precise localization. On the contrary, earlier layers may be precise in localization but will not capture semantics. To get the best of both worlds, we define the hypercolumn at a pixel as the vector of activations of all CNN units above that pixel. Using hypercolumns as pixel descriptors, we show results on three fine-grained localization tasks: simultaneous detection and segmentation\[22\], where we improve state-of-the-art from 49.7\[22\] mean AP^r to 60.0, keypoint localization, where we get a 3.3 point boost over\[20\] and part labeling, where we show a 6.6 point gain over a strong baseline.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Semantic Part Segmentation on Horse-Cow Horse (test)](<https://www.sota2.com/research/sota/semantic-part-segmentation-on-horse-cow-horse-test.md>): Semantic Part Segmentation; Horse-Cow Horse (test); Bkg Accuracy: 85.71.

- [Semantic Part Segmentation on Horse-Cow Cow (test)](<https://www.sota2.com/research/sota/semantic-part-segmentation-on-horse-cow-cow-test.md>): Semantic Part Segmentation; Horse-Cow Cow (test); Bkg Score: 81.86.

- [Instance Segmentation on PASCAL VOC 2012 (val)](<https://www.sota2.com/research/sota/instance-segmentation-on-pascal-voc-2012-val.md>): Instance Segmentation; PASCAL VOC 2012 (val); mAP @0.5: 60.

- [Semantic Segmentation on PASCAL VOC 2012 (test)](<https://www.sota2.com/research/sota/semantic-segmentation-on-pascal-voc-2012-test.md>): Semantic segmentation; PASCAL VOC 2012 (test); mIoU: 59.2.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1411.5752>)

[PDF](<https://arxiv.org/pdf/1411.5752.pdf>)
