# More than the Sum of Its Parts: Ensembling Backbone Networks for Few-Shot Segmentation

Source: [More than the Sum of Its Parts: Ensembling Backbone Networks for Few-Shot Segmentation](<https://www.sota2.com/research/paper/68fa72291e209131cea54dcd>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:20:14.513Z

Authors: Nico Catalano, Alessandro Maranelli, Agnese Chiatti, Matteo Matteucci

Published: 2024-02-09T18:01:15.000Z

## Abstract

Semantic segmentation is a key prerequisite to robust image understanding for applications in \\acrlong{ai} and Robotics. \\acrlong{fss}, in particular, concerns the extension and optimization of traditional segmentation methods in challenging conditions where limited training examples are available. A predominant approach in \\acrlong{fss} is to rely on a single backbone for visual feature extraction. Choosing which backbone to leverage is a deciding factor contributing to the overall performance. In this work, we interrogate on whether fusing features from different backbones can improve the ability of \\acrlong{fss} models to capture richer visual features. To tackle this question, we propose and compare two ensembling techniques-Independent Voting and Feature Fusion. Among the available \\acrlong{fss} methods, we implement the proposed ensembling techniques on PANet. The module dedicated to predicting segmentation masks from the backbone embeddings in PANet avoids trainable parameters, creating a controlled \`in vitro' setting for isolating the impact of different ensembling strategies. Leveraging the complementary strengths of different backbones, our approach outperforms the original single-backbone PANet across standard benchmarks even in challenging one-shot learning scenarios. Specifically, it achieved a performance improvement of +7.37\\% on PASCAL-5\\textsuperscript{i} and of +10.68\\% on COCO-20\\textsuperscript{i} in the top-performing scenario where three backbones are combined. These results, together with the qualitative inspection of the predicted subject masks, suggest that relying on multiple backbones in PANet leads to a more comprehensive feature representation, thus expediting the successful application of \\acrlong{fss} methods in challenging, data-scarce environments.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2402.06581>)

[PDF](<https://arxiv.org/pdf/2402.06581.pdf>)
