Movie Dubbing on CinePile Dub
60.04SPKSIM (%)CoSync-DiT
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CoSync-DiTSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 60.04 | 5.59 | 77.41 | 0.332 | 3.4 | 45.24 | |
| AlignDiTSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 58.9 | 20.98 | 77.39 | 0.342 | 3.36 | 31.77 | |
| HPMDubbingSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 42.72 | 99.2 | 61.22 | 0.391 | 3.23 | 17 | |
| StyleDubberSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 41.65 | 74.96 | 63.88 | 0.362 | 2.89 | 22.56 | |
| ProDubberSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 28.86 | 5.25 | 70.35 | 0.335 | 2.93 | 21.79 | |
| InstructDubSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 27.61 | 4.61 | 65.97 | 0.37 | 2.95 | 17.65 | |
| EmoDubberSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 23.1 | 49.57 | 70.08 | 0.337 | 3.05 | 13.75 | |
| FlowDubberSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 22.68 | 54.41 | 67.39 | 0.354 | 3.04 | 13.58 | |
| HD-DubberSetting=Zero-shot, Training dataset=CelebV-Dub2026.04 | 5.84 | 42.75 | 56.32 | 0.337 | 2.58 | 19.33 |