# BSUV-Net 2.0: Spatio-Temporal Data Augmentations for Video-Agnostic Supervised Background Subtraction

Source: [BSUV-Net 2.0: Spatio-Temporal Data Augmentations for Video-Agnostic Supervised Background Subtraction](<https://www.sota2.com/research/paper/68fa69541e209131cea2194d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:06:39.448Z

Authors: M. Ozan Tezcan, Prakash Ishwar, Janusz Konrad

Published: 2021-01-23T21:11:29.000Z

## Abstract

Background subtraction (BGS) is a fundamental video processing task which is a key component of many applications. Deep learning-based supervised algorithms achieve very good perforamnce in BGS, however, most of these algorithms are optimized for either a specific video or a group of videos, and their performance decreases dramatically when applied to unseen videos. Recently, several papers addressed this problem and proposed video-agnostic supervised BGS algorithms. However, nearly all of the data augmentations used in these algorithms are limited to the spatial domain and do not account for temporal variations that naturally occur in video data. In this work, we introduce spatio-temporal data augmentations and apply them to one of the leading video-agnostic BGS algorithms, BSUV-Net. We also introduce a new cross-validation training and evaluation strategy for the CDNet-2014 dataset that makes it possible to fairly and easily compare the performance of various video-agnostic supervised BGS algorithms. Our new model trained using the proposed data augmentations, named BSUV-Net 2.0, significantly outperforms state-of-the-art algorithms evaluated on unseen videos of CDNet-2014. We also evaluate the cross-dataset generalization capacity of BSUV-Net 2.0 by training it solely on CDNet-2014 videos and evaluating its performance on LASIESTA dataset. Overall, BSUV-Net 2.0 provides a ~5% improvement in the F-score over state-of-the-art methods on unseen videos of CDNet-2014 and LASIESTA datasets. Furthermore, we develop a real-time variant of our model, that we call Fast BSUV-Net 2.0, whose performance is close to the state of the art.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Background Subtraction on CDnet Shadow, Camera Jitter, Dynamic Background, Baseline, Intermittent Object Motion, PTZ 2014](<https://www.sota2.com/research/sota/background-subtraction-on-cdnet-shadow-camera-jitter-dynamic-background-baseline-intermittent-object-motion-ptz-2014.md>): Background Subtraction; CDnet Shadow, Camera Jitter, Dynamic Background, Baseline, Intermittent Object Motion, PTZ 2014; nbShadowError (busStation): 23149.

- [Background Subtraction on CDnet 2014 (full)](<https://www.sota2.com/research/sota/background-subtraction-on-cdnet-2014-full.md>): Background Subtraction; CDnet 2014 (full); F1 (baseline): 96.2.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2101.09585>)

[PDF](<https://arxiv.org/pdf/2101.09585.pdf>)
