# Accelerating Video Object Segmentation with Compressed Video

Source: [Accelerating Video Object Segmentation with Compressed Video](<https://www.sota2.com/research/paper/68fa6c2c1e209131cea3289d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-04T05:10:22.455Z

Authors: Kai Xu, Angela Yao

Published: 2021-07-26T12:57:04.000Z

## Abstract

We propose an efficient plug-and-play acceleration framework for semi-supervised video object segmentation by exploiting the temporal redundancies in videos presented by the compressed bitstream. Specifically, we propose a motion vector-based warping method for propagating segmentation masks from keyframes to other frames in a bi-directional and multi-hop manner. Additionally, we introduce a residual-based correction module that can fix wrongly propagated segmentation masks from noisy or erroneous motion vectors. Our approach is flexible and can be added on top of several existing video object segmentation algorithms. We achieved highly competitive results on DAVIS17 and YouTube-VOS on various base models with substantial speed-ups of up to 3.5X with minor drops in accuracy.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Video Object Segmentation on DAVIS 2017 (val)](<https://www.sota2.com/research/sota/video-object-segmentation-on-davis-2017-val.md>): Video Object Segmentation; DAVIS 2017 (val); J mean: 79.7.

- [Video Object Segmentation on YouTube-VOS 2018 (val)](<https://www.sota2.com/research/sota/video-object-segmentation-on-youtube-vos-2018-val.md>): Video Object Segmentation; YouTube-VOS 2018 (val); J Score (Seen): 79.4.

- [Video Object Segmentation on DAVIS 2016 (val)](<https://www.sota2.com/research/sota/video-object-segmentation-on-davis-2016-val.md>): Video Object Segmentation; DAVIS 2016 (val); J Mean: not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2107.12192>)

[PDF](<https://arxiv.org/pdf/2107.12192.pdf>)

[Implementation](<https://github.com/kai422/CoVOS>)
