User Study
Benchmarks
TaskDatasetSOTA resultTrendResults
User Study Single-object 4D Motion Generation 1.0 (test)
47Prompt Alignment
36
User Study 100 images (test)
94.3User Selection Rate
32
User Study
83.9Overall Quality Score
30
User Study
4.46Lip Sync Quality
18
User Study (N=24) (between-subjects)
10Mentions
17
User Study Personalization Tasks
95.3Concept Preservation (CP)
17
User Study
6.55Interaction Plausibility Score
16
User Study Franka Panda
37Failure Rate
16
User Study 12 Prompts (test)
82.84Win Rate (Full Description)
13
User Study
4.62C-A Score
13
User Study
1.52Average Ranking
13
User Study
89.67Overall Quality Preference
13
User Study Generation-only (completed-session)
100Pairwise Preference Rate
12
User Study Extended Emotion
91Emotional Accuracy
12
User Study Basic Emotion
84.5Emotional Expression
12
User Study Human Evaluation
60VisualPrompter Preference
12
User Study
92.2Preference Rate
12
User Study 40 random images (test)
1.6UOM
12
User Study
1.54Average Ranking
12
User Study
96Lip Sync Accuracy (S)
11
User Study
156Lip Sync
11
User Study
49.1ID Score
11
User Study
8.4Semantic Faithfulness
10
User Study
71Prompt Alignment
10
User Study Industry
55.01Average Score
10