Reference-image-conditioned joint audio-video generation on User Study (test)
3.41Lip-Sync AccuracyMMControl
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MMControlInput=Reference image only2026.04 | 3.41 | 3.6 | 3.58 | 3.57 | 3.56 | 3.77 | 3.58 | |
| Hallo3Input=Ground-truth audio and first video frame2026.04 | 3.07 | 3.11 | 3.08 | 3.28 | 3.53 | 3.22 | 3.22 | |
| HunyuanCustomInput=Ground-truth audio and first video frame2026.04 | 2.9 | 3.17 | 3.21 | 3.18 | 3.38 | 3.39 | 3.2 | |
| SadTalkerInput=Ground-truth audio and first video frame2026.04 | 2.35 | 1.78 | 1.78 | 2.78 | 3.31 | 2.68 | 2.45 | |
| AniPortraitInput=Ground-truth audio and first video frame2026.04 | 1.53 | 1.64 | 1.58 | 2.56 | 3.15 | 2.37 | 2.14 |