Visual Speech Recognition on LRS3 low-resource (test)
19.3WERSerdyuk et al. (2022)
Evaluation Results
| Method | Links | |
|---|---|---|
| Serdyuk et al. (2022)Encoder=Conformer, LM=false, Lab hrs=90,000*2022.12 | 19.3 | |
| RAVEn w/ self-trainingEncoder=Transformer, LM=true, Unlab hrs=1,759, Lab hrs=30, Model size=Large2022.12 | 23.8 | |
| RAVEn w/ self-trainingEncoder=Transformer, LM=false, Unlab hrs=1,759, Lab hrs=30, Model size=Large2022.12 | 24.8 | |
| Serdyuk et al. (2021)Encoder=Transformer, LM=false, Lab hrs=90,000*2022.12 | 25.9 | |
| Shi et al. (2022) w/ self-trainingEncoder=Transformer, LM=false, Unlab hrs=1,759, Lab hrs=30, Model size=Large2022.12 | 28.6 | |
| Prajwal et al. (2022)Encoder=Transformer, LM=true, Lab hrs=2,676*2022.12 | 30.7 | |
| Shi et al. (2022)Encoder=Transformer, LM=false, Unlab hrs=1,759, Lab hrs=30, Model size=Large2022.12 | 32.5 | |
| RAVEnEncoder=Transformer, LM=false, Unlab hrs=1,759, Lab hrs=30, Model size=Large2022.12 | 32.5 | |
| Makino et al. (2019)Encoder=RNN, LM=false, Lab hrs=31,000*2022.12 | 33.6 | |
| Ma et al. (2022)Encoder=Conformer, LM=true, Lab hrs=8132022.12 | 34.7 | |
| RAVEnEncoder=Transformer, LM=false, Unlab hrs=1,759, Lab hrs=30, Model size=Base2022.12 | 40.2 | |
| Shi et al. (2022)Encoder=Transformer, LM=false, Unlab hrs=1,759, Lab hrs=30, Model size=Base2022.12 | 46.1 | |
| RAVEnEncoder=Transformer, LM=false, Unlab hrs=433, Lab hrs=30, Model size=Base2022.12 | 47 | |
| Shi et al. (2022)Encoder=Transformer, LM=false, Unlab hrs=433, Lab hrs=30, Model size=Base2022.12 | 51.8 | |
| Shillingford et al. (2019)Encoder=RNN, Lab hrs=3,886*2022.12 | 55.1 | |
| Xu et al. (2020)Encoder=RNN, LM=false, Lab hrs=5902022.12 | 57.8 | |
| Afouras et al. (2018a)Encoder=Transformer, LM=true, Lab hrs=1,519*2022.12 | 58.9 | |
| Zhang et al. (2022)Encoder=Transformer, LM=false, Unlab hrs=433, Lab hrs=30, Model size=Base2022.12 | 67.8 | |
| Base modelEncoder=Transformer, LM=false, Lab hrs=30, Pre-training=from scratch2022.12 | 93.4 | |
| Large modelEncoder=Transformer, LM=false, Lab hrs=30, Pre-training=from scratch2022.12 | 95.5 |