# Stitch it in Time: GAN-Based Facial Editing of Real Videos

Source: [Stitch it in Time: GAN-Based Facial Editing of Real Videos](<https://www.sota2.com/research/paper/68fa6ba51e209131cea2f8cf>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-14T18:14:40.510Z

Authors: Rotem Tzaban, Ron Mokady, Rinon Gal, Amit H. Bermano, Daniel Cohen-Or

Published: 2022-01-20T18:48:20.000Z

## Abstract

The ability of Generative Adversarial Networks to encode rich semantics within their latent space has been widely adopted for facial image editing. However, replicating their success with videos has proven challenging. Sets of high-quality facial videos are lacking, and working with videos introduces a fundamental barrier to overcome - temporal coherency. We propose that this barrier is largely artificial. The source video is already temporally coherent, and deviations from this state arise in part due to careless treatment of individual components in the editing pipeline. We leverage the natural alignment of StyleGAN and the tendency of neural networks to learn low frequency functions, and demonstrate that they provide a strongly consistent prior. We draw on these insights and propose a framework for semantic editing of faces in videos, demonstrating significant improvements over the current state-of-the-art. Our method produces meaningful face manipulations, maintains a higher degree of temporal consistency, and can be applied to challenging, high quality, talking head videos which current methods struggle with.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Face Inversion on VoxCeleb](<https://www.sota2.com/research/sota/face-inversion-on-voxceleb.md>): Face Inversion; VoxCeleb; Sim to Source: 0.9261.

- [Age Editing on VoxCeleb](<https://www.sota2.com/research/sota/age-editing-on-voxceleb.md>): Age Editing; VoxCeleb; Source Similarity: 0.7891.

- [Angle Editing on VoxCeleb](<https://www.sota2.com/research/sota/angle-editing-on-voxceleb.md>): Angle Editing; VoxCeleb; Similarity to Source: 0.6695.

- [Video Editing on VoxCeleb subset](<https://www.sota2.com/research/sota/video-editing-on-voxceleb-subset.md>): Video Editing; VoxCeleb subset; FID (Age Edit): 15.8021.

- [Video Inversion on VoxCeleb](<https://www.sota2.com/research/sota/video-inversion-on-voxceleb.md>): Video Inversion; VoxCeleb; PSNR: 38.0134.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2201.08361>)

[PDF](<https://arxiv.org/pdf/2201.08361.pdf>)

[Implementation](<https://stitch-time.github.io/>)
