User Study
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
User Study (test)
100ID Preservation Score
6
User Study
78.67SA
6
User Study (test)
39.51EPS (%)
6
User Study
85.2Editing Consistency Score
6
User Study
82.3Preference Rate (%)
6
User Study Evaluation Dataset
82Selection Frequency (Top-2)
6
User Study
4.655Faithfulness
6
User Study 20 video subjects (test)
68.17Average Vote Percentage
6
User Study
4.71Geometry Quality Score
6
User Study
92HOI Consistency
6
User Study
76.7User Study Score
6
User study (Amazon Mechanical Turk)
95Result Quality
6
User Study
82Instruction Following
6
User Study
72.8User Preference Score
6
User Study 24 prompts 1.0 (test)
100Geometry Quality
6
User Study Evaluation Set
83.7Preference Rate
6
User Study (120 videos, 15 subjects, 8 prompts each)
70.4Text Alignment
6
User Study 15 prompts (test)
94.5User Preference Rate
6
User Study
4.4Image Quality
6
User Study Video
2.042B-T Score
6
User Study
0.603Content Consistency
6
User Study 60 input-edit pairs
3.36Human Preference Score
5
User Study 13 scenes (test)
69.51Quality
5
User study
4.78Style Similarity Score
5
User Study
46.2Motion Following Preference
5