# Deep Video Harmonization with Color Mapping Consistency

Source: [Deep Video Harmonization with Color Mapping Consistency](<https://www.sota2.com/research/paper/68fa6c7b1e209131cea3438a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:11:46.889Z

Authors: Xinyuan Lu, Shengyuan Huang, Li Niu, Wenyan Cong, Liqing Zhang

Published: 2022-05-02T07:10:18.000Z

## Abstract

Video harmonization aims to adjust the foreground of a composite video to make it compatible with the background. So far, video harmonization has only received limited attention and there is no public dataset for video harmonization. In this work, we construct a new video harmonization dataset HYouTube by adjusting the foreground of real videos to create synthetic composite videos. Moreover, we consider the temporal consistency in video harmonization task. Unlike previous works which establish the spatial correspondence, we design a novel framework based on the assumption of color mapping consistency, which leverages the color mapping of neighboring frames to refine the current frame. Extensive experiments on our HYouTube dataset prove the effectiveness of our proposed framework. Our dataset and code are available at https://github.com/bcmi/Video-Harmonization-Dataset-HYouTube.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Video Harmonization on HYouTube (test)](<https://www.sota2.com/research/sota/video-harmonization-on-hyoutube-test.md>): Video Harmonization; HYouTube (test); fMSE: 186.72.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2205.00687>)

[PDF](<https://arxiv.org/pdf/2205.00687.pdf>)