# Fr\\'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos

Source: [Fr\\'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos](<https://www.sota2.com/research/paper/68fa74471e209131cea60b4f>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:37:02.192Z

Authors: Jiahe Liu, Youran Qu, Qi Yan, Xiaohui Zeng, Lele Wang, Renjie Liao

Published: 2024-07-23T02:10:50.000Z

## Abstract

Significant advancements have been made in video generative models recently. Unlike image generation, video generation presents greater challenges, requiring not only generating high-quality frames but also ensuring temporal consistency across these frames. Despite the impressive progress, research on metrics for evaluating the quality of generated videos, especially concerning temporal and motion consistency, remains underexplored. To bridge this research gap, we propose Fr\\'echet Video Motion Distance (FVMD) metric, which focuses on evaluating motion consistency in video generation. Specifically, we design explicit motion features based on key point tracking, and then measure the similarity between these features via the Fr\\'echet distance. We conduct sensitivity analysis by injecting noise into real videos to verify the effectiveness of FVMD. Further, we carry out a large-scale human study, demonstrating that our metric effectively detects temporal noise and aligns better with human perceptions of generated video quality than existing metrics. Additionally, our motion features can consistently improve the performance of Video Quality Assessment (VQA) models, indicating that our approach is also applicable to unary video quality evaluation. Code is available at https://github.com/ljh0v0/FMD-frechet-motion-distance.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [AI-generated video detection on GenVidBench matched 27k](<https://www.sota2.com/research/sota/ai-generated-video-detection-on-genvidbench-matched-27k.md>): AI-generated Video Detection; GenVidBench matched 27k; Audited LOGO OOD (AUC): 88.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2407.16124>)

[PDF](<https://arxiv.org/pdf/2407.16124.pdf>)