# Semantic Frame Interpolation

Source: [Semantic Frame Interpolation](<https://www.sota2.com/research/paper/68fa79ed1e209131cea8004c>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-08-07T05:00:06.522Z

Authors: Yijia Hong, Jiangning Zhang, Ran Yi, Weijian Cao, Xiaobin Hu, Lizhuang Ma, Shuicheng Yan

Published: 2025-07-07T16:25:47.000Z

## Abstract

Generating intermediate video content of varying lengths based on given first and last frames, along with text prompt information, offers significant research and application potential. However, traditional frame interpolation tasks primarily focus on scenarios with a small number of frames, no text control, and minimal differences between the first and last frames. Recent community developers have utilized large video models represented by Wan to endow frame-to-frame capabilities. However, these models can only generate a fixed number of frames and often fail to produce satisfactory results for certain frame lengths, while this setting lacks a clear official definition and a well-established benchmark. In this paper, we first propose a new practical Semantic Frame Interpolation (SFI) task from the perspective of academic definition, which covers the above two settings and supports inference at multiple frame rates. To achieve this goal, we propose a novel SemFi model building upon Wan2.1, which incorporates a Mixture-of-LoRA module to ensure the generation of high-consistency content that aligns with control conditions across various frame length limitations. Furthermore, we propose SFI-300K, the first general-purpose dataset and benchmark specifically designed for SFI. To support this, we collect and process data from the perspective of SFI, carefully designing evaluation metrics and methods to assess the model's performance across multiple dimensions, encompassing image and video, and various aspects, including consistency and diversity. Through extensive experiments on SFI-300K, we demonstrate that our method is particularly well-suited to meet the requirements of the SFI task.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Video Frame Interpolation on VidGen 1M (test)](<https://www.sota2.com/research/sota/video-frame-interpolation-on-vidgen-1m-test.md>): Video Frame Interpolation; VidGen 1M (test); FVD: 622.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2507.05173>)

[PDF](<https://arxiv.org/pdf/2507.05173.pdf>)
