Portrait Image Animation on HDTF (test)
16.68FIDCogPortrait
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CogPortraitbackbone=DiT, refinement=KTO-based2026.05 | 16.68 | 32.9 | 0.0633 | 7.15 | — | — | 0.9214 | 0.0107 | |
| Follow-Your-Emojiinput_category=video-driven2026.05 | 18.22 | 72.11 | 0.0929 | 4.83 | — | — | 0.8609 | 0.0173 | |
| HunyuanPortraitinput_category=video-driven2026.05 | 18.68 | 39.79 | 0.0962 | 6.22 | — | — | 0.8837 | 0.0293 | |
| Sonicinput_category=audio-driven2026.05 | 24.66 | 51.65 | 0.1075 | 7.43 | — | — | 0.8609 | 0.0363 | |
| ACTalkerinput_category=video-driven2026.05 | 27.92 | 37.64 | 0.1934 | 7.02 | — | — | 0.8651 | 0.0217 | |
| Hallo2025.01 | 28.605 | 343.023 | 0.167 | 6.254 | 8.735 | — | — | — | |
| MoEE2025.01 | 28.834 | 322.625 | 0.152 | 6.114 | 9.101 | — | — | — | |
| LetsTalk-LModel Variant=Large2024.11 | 31.761 | 219.119 | — | 4.675 | 8.149 | 1.962 | — | — | |
| AniPortrait2025.01 | 36.826 | 476.818 | 0.211 | 5.977 | 9.898 | — | — | — | |
| Hallo3Number of parameters=8B2024.11 | 42.156 | 248.912 | — | 4.51 | 8.195 | 1.995 | — | — | |
| Hallo2Number of parameters=2.4B2024.11 | 44.343 | 241.628 | — | 4.482 | 8.121 | 2.017 | — | — | |
| FantasyTalkinginput_category=audio-driven2026.05 | 44.79 | 51.46 | 0.0887 | 6.95 | — | — | 0.8957 | 0.0346 | |
| HalloNumber of parameters=2.4B2024.11 | 45.754 | 285.988 | — | 4.235 | 8.382 | 2.235 | — | — | |
| LetsTalk-BModel Variant=Base2024.11 | 46.24 | 289.385 | — | 4.236 | 8.693 | 2.587 | — | — | |
| EchoMimic2025.01 | 48.323 | 526.125 | 0.312 | 6.73 | 9.157 | — | — | — | |
| Hallo3input_category=audio-driven2026.05 | 53.85 | 45.76 | 0.1885 | 5.92 | — | — | 0.8622 | 0.0255 | |
| EchoMimicNumber of parameters=2.6B2024.11 | 55.791 | 299.343 | — | 3.398 | 8.987 | 2.493 | — | — | |
| FLOATinput_category=audio-driven2026.05 | 72.77 | 99.25 | 0.2676 | 6.92 | — | — | 0.7651 | 0.0781 | |
| StyleTalk2025.01 | 76.564 | 502.334 | 0.326 | 3.885 | 10.644 | — | — | — | |
| AniPortraitNumber of parameters=2.8B2024.11 | 78.284 | 331.117 | — | 3.107 | 9.032 | 2.903 | — | — | |
| EAT2025.01 | 81.254 | 545.266 | 0.357 | 5.012 | 9.885 | — | — | — | |
| EDTalkinput_category=label-driven2026.05 | 98.77 | 142.88 | 0.1749 | 5.67 | — | — | 0.8336 | 0.021 | |
| SadTalkerNumber of parameters=138M2024.11 | 102.371 | 362.634 | — | 4.412 | 7.723 | 2.168 | — | — |