Lip Synchronization on HDTF 52 (test)
8.98Sync-COmniAvatar-LS
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OmniAvatar-LSmodel_scale=14B, Steps=50, FPS=0.38, TTFF=213.722026.06 | 8.98 | 6.11 | 93.4 | 6.71 | 133.87 | 91.1 | |
| Wav2LipSteps=–, FPS=479.60, TTFF=0.172026.06 | 8.56 | 6.7 | 94.6 | 24.15 | 384.82 | 91.1 | |
| Diff2LipSteps=25, FPS=15.47, TTFF=5.042026.06 | 8.35 | 6.32 | 94.3 | 20.32 | 285.69 | 90.7 | |
| VideoReTalkingSteps=–, FPS=2.67, TTFF=3.762026.06 | 8.22 | 6.7 | 91 | 24.59 | 306.63 | 88.3 | |
| LatentSyncSteps=20, FPS=3.23, TTFF=6.292026.06 | 8.1 | 6.51 | 96.7 | 6.9 | 117.91 | 95 | |
| OmniAvatar-LSmodel_scale=1.3B, Steps=50, FPS=1.79, TTFF=45.362026.06 | 8.04 | 6.99 | 92.7 | 8.06 | 143.75 | 90.4 | |
| Ground truthSteps=–, FPS=–, TTFF=–2026.06 | 7.95 | 6.92 | — | — | — | — | |
| MuseTalkSteps=1, FPS=23.07, TTFF=2.722026.06 | 7.94 | 6.95 | 95.7 | 9.68 | 127.44 | 94.3 | |
| Lip Forcingmodel_scale=14B, Steps=2, FPS=15.11, TTFF=0.542026.06 | 7.59 | 7.23 | 94.9 | 7.01 | 107.88 | 93.8 | |
| X-DubSteps=30, FPS=0.91, TTFF=163.642026.06 | 7.58 | 7.66 | 89.8 | 14.76 | 183.99 | 83.1 | |
| Self Forcingmodel_scale=1.3B, Steps=4, FPS=27.48, TTFF=0.382026.06 | 7.12 | 7.8 | 93.9 | 7.51 | 124.78 | 91.5 | |
| Lip Forcingmodel_scale=1.3B, Steps=2, FPS=31.58, TTFF=0.322026.06 | 6.88 | 7.93 | 94.3 | 6.76 | 118.86 | 91.9 |