Audio-Visual Speech Resynthesis on LRS2 (test)
2.875LSE-C (Original Audio)U2S+LipGAN
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| U2S+LipGANInput Type=Resynthesized Audio Visual Speeches, Vocoder=U2S2023.12 | 2.875 | 11.431 | 3.057 | 10.964 | 11.91 | 671.49 | — | |
| U2S+Wav2LipInput Type=Resynthesized Audio Visual Speeches, Vocoder=U2S2023.12 | 5.742 | 7.958 | 6.298 | 7.305 | 5.52 | 544.37 | — | |
| Video(GT)Input Type=Real Audio Visual Speeches2023.12 | 6.221 | 7.407 | — | — | — | — | — | |
| Audio(GT)+Wav2lipInput Type=Real Audio Visual Speeches2023.12 | 6.498 | 7.143 | — | — | 5.08 | — | — | |
| Unit2LipInput Type=Resynthesized Audio Visual Speeches, Architecture=Single-stage2023.12 | 7.343 | 7.193 | 7.28 | 7.097 | 5.14 | 2,369.66 | — |