# Panoptic SwiftNet: Pyramidal Fusion for Real-time Panoptic Segmentation

Source: [Panoptic SwiftNet: Pyramidal Fusion for Real-time Panoptic Segmentation](<https://www.sota2.com/research/paper/68fa6f161e209131cea43d69>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T01:13:37.852Z

Authors: Josip \\v{S}ari\\'c, Marin Or\\v{s}i\\'c, Sini\\v{s}a \\v{S}egvi\\'c

Published: 2022-03-15T13:47:40.000Z

## Abstract

Dense panoptic prediction is a key ingredient in many existing applications such as autonomous driving, automated warehouses or remote sensing. Many of these applications require fast inference over large input resolutions on affordable or even embedded hardware. We propose to achieve this goal by trading off backbone capacity for multi-scale feature extraction. In comparison with contemporaneous approaches to panoptic segmentation, the main novelties of our method are efficient scale-equivariant feature extraction, cross-scale upsampling through pyramidal fusion and boundary-aware learning of pixel-to-instance assignment. The proposed method is very well suited for remote sensing imagery due to the huge number of pixels in typical city-wide and region-wide datasets. We present panoptic experiments on Cityscapes, Vistas, COCO and the BSB-Aerial dataset. Our models outperform the state of the art on the BSB-Aerial dataset while being able to process more than a hundred 1MPx images per second on a RTX3090 GPU with FP16 precision and TensorRT optimization.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2203.07908>)

[PDF](<https://arxiv.org/pdf/2203.07908.pdf>)