Video-to-speech synthesis on LRS2-BBC (test)
3.921UTMOSOurs
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OursSpeaker embedding type=Video-driven, Steps=102025.03 | 3.921 | 2.586 | 43.441 | 39.37 | |
| OursSpeaker embedding type=Video-driven, Steps=10002025.03 | 3.881 | 2.552 | 43.702 | 39.05 | |
| Ground Truth2025.03 | 3.013 | 2.256 | — | 8.93 | |
| DiffV2SSpeaker embedding type=Video-driven, Steps=10002025.03 | 2.945 | 2.363 | 44.414 | 54.86 | |
| IntelligibleSpeaker embedding type=Audio-driven2025.03 | 2.331 | 2 | 41.233 | 39.53 | |
| LTBSSpeaker embedding type=Video-driven2025.03 | 2.288 | 2.174 | 43.653 | 94.25 | |
| SVTSSpeaker embedding type=Audio-driven2025.03 | 1.387 | 1.434 | 53.475 | 83.38 |