User Study
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
User Study 20 queries on PolyHaven-rendered objects
154Detail Preservation
4
User Study Instruction-based Editing
3.712Quality
4
User Study 25 participants
86.06Lip Sync Score
4
User Study 30 samples (curated)
95.4L-A Score
4
User Study (videos from DAVIS, Pexels, synthetic CG, and naive composites) (test)
92Text Fidelity
4
User Study
4.08Overall Score
4
User Study 9 generation cases
57Concept Alignment
4
User Study Text Condition (test)
4.14Style Consistency
4
User Study
3.94Structural Similarity
4
User Study 180° viewpoint
4.2Prompt Match Score
4
User Study 90° viewpoint
4.4Prompt Match
4
User Study 30° viewpoint
4.5Prompt Match Score
4
User Study
92.31Image Alignment
4
User Study
55WAC
4
User study
6.23Graphic Quality
4
User Study 50 video samples
3.2Temporal Coherence
4
User Study 62 text prompts
91.8Overall Win Rate
4
User Study 30 clips (test)
37.5Identity Preservation
4
User Study 30 clips (test)
45Identity Preservation
4
User Study Fixed views
3.93Motion Quality Score
4
User Study Novel views
4.26Motion Score
4
User Study 10 prompts (test)
9,060User Preference Frequency
4
User Study
4.8Compliance Score
4
User Study Single-concept
3.62Alignment
4
User Study 8 sets of generated videos (test)
51.6Graphics Quality
4