Lip-syncing on LRS2 1 (test)
6.386LSE-DWav2Lip
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Wav2Lipvisual quality discriminator=false2020.08 | 6.386 | 7.789 | 4.887 | |
| Wav2Lip + GANvisual quality discriminator=true2020.08 | 6.469 | 7.781 | 4.446 | |
| Real Videos2020.08 | 6.736 | 7.838 | — | |
| Wav2Lip + ViT + MARLINBackbone=ViT, Pre-training=MARLIN, Pre-training Dataset=YTF2022.11 | 7.127 | 5.528 | 3.452 | |
| Wav2Lip + ViT + VideoMAEBackbone=ViT, Pre-training=VideoMAE, Pre-training Dataset=YTF2022.11 | 7.316 | 5.096 | 4.097 | |
| AttnWav2Lip2022.11 | 7.339 | 6.53 | — | |
| Wav2Lip2022.11 | 7.521 | 6.406 | 4.887 | |
| Wav2Lip + ViTBackbone=ViT, Training=Trained from scratch2022.11 | 8.996 | 2.807 | 13.352 | |
| LipGAN2020.08 | 10.33 | 3.199 | 4.861 | |
| LipGAN2022.11 | 10.33 | 3.199 | 4.861 | |
| Speech2Vid2020.08 | 14.23 | 1.587 | 12.32 | |
| Speech2Vid2022.11 | 14.23 | 1.587 | 12.32 |