# Temporal Aware Pruning for Efficient Diffusion-based Video Generation

Source: [Temporal Aware Pruning for Efficient Diffusion-based Video Generation](<https://www.sota2.com/research/paper/6a0beef1dbc836b87d82c8ff>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-23T05:00:04.712Z

Authors: Sheng Li, Yang Sui, Junhao Ran, Bo Yuan, Yue Dai, Xulong Tang

Published: 2026-05-18T04:18:24.000Z

## Abstract

Video diffusion models have recently enabled high-quality video generation with ViT-based architectures, but remain computationally intensive because generation requires attention computation over long spatiotemporal sequences. Token pruning has proven effective for ViTs and VLMs. However, most prior pruning methods are attention-based and operate per frame, failing to ensure the vital temporal coherence across frames in video generation tasks. In practice, naively adopting attention-only pruning causes noticeable degradation due to worsened background consistency, flickering, and reduced image quality. To address this, we propose TAPE, a training-free Temporal Aware Pruning for Efficient diffusion-based video generation. TAPE (i) applies temporal smoothing to align token-importance across adjacent frames and suppress selection jitter; and (ii) performs token reselection in selected layers to align token pruning with layers' diverse semantic focus and avoid error accumulation in specific areas; it also (iii) adopt a timestep-level budget scheduling that prunes aggressively at early noisy steps and relaxes pruning during fidelity-critical refinement. The experimental results show that TAPE delivers significant speedups while preserving high visual fidelity, outperforming prior token reduction approaches.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Text-to-Video Generation on VBench (Total, Quality, Semantic Scores, and Speedup)](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-total-quality-semantic-scores-and-speedup.md>): Text-to-Video Generation; VBench; Speedup: 1.8.

- [Text-to-Video Generation on VBench standard (test)](<https://www.sota2.com/research/sota/text-to-video-generation-on-vbench-standard-test.md>): Text-to-Video Generation; VBench standard (test); Speedup: 1.8.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2605.17837>)

[PDF](<https://arxiv.org/pdf/2605.17837.pdf>)
