# MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation

Source: [MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation](<https://www.sota2.com/research/paper/68fa717c1e209131cea518f0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:07:38.985Z

Authors: Xiaojie Fang, Xingguo Song, Xiangyin Meng, Xu Fang, Sheng Jin

Published: 2023-12-12T12:20:27.000Z

## Abstract

The low-level spatial detail information and high-level semantic abstract information are both essential to the semantic segmentation task. The features extracted by the deep network can obtain rich semantic information, while a lot of spatial information is lost. However, how to recover spatial detail information effectively and fuse it with high-level semantics has not been well addressed so far. In this paper, we propose a new architecture based on Bilateral Segmentation Network (BiseNet) called Multi-scale Covariance Feature Fusion Network (MCFNet). Specifically, this network introduces a new feature refinement module and a new feature fusion module. Furthermore, a gating unit named L-Gate is proposed to filter out invalid information and fuse multi-scale features. We evaluate our proposed model on Cityscapes, CamVid datasets and compare it with the state-of-the-art methods. Extensive experiments show that our method achieves competitive success. On Cityscapes, we achieve 75.5% mIOU with a speed of 151.3 FPS.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2312.07207>)

[PDF](<https://arxiv.org/pdf/2312.07207.pdf>)
