Automatic Speech Recognition on LibriSpeech and Common Voice
0.051WERRank-Based Tournament
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Rank-Based TournamentModel=Whisper-Large (W.L), SNR=5.02026.06 | 0.051 | 90.3 | -0.574 | |
| Naive Cohen randomized smoothingModel=Whisper-Large (W.L), SNR=5.02026.06 | 0.052 | 8.2 | -0.348 | |
| Naive Cohen randomized smoothingModel=Whisper-Small (W.S), SNR=10.02026.06 | 0.058 | 0 | 0.009 | |
| Rank-Based TournamentModel=Whisper-Small (W.S), SNR=10.02026.06 | 0.058 | 56.7 | -0.6 | |
| Naive Cohen randomized smoothingModel=Whisper-Small (W.S), SNR=5.02026.06 | 0.061 | 0 | -0.096 | |
| Rank-Based TournamentModel=Whisper-Small (W.S), SNR=5.02026.06 | 0.061 | 87.3 | -0.608 | |
| Naive Cohen randomized smoothingModel=Whisper-Large (W.L), SNR=0.02026.06 | 0.064 | 3.5 | -0.313 | |
| Rank-Based TournamentModel=Whisper-Large (W.L), SNR=0.02026.06 | 0.064 | 84 | -0.315 | |
| Raw BaselineModel=Whisper-Small (W.S), SNR=10.02026.06 | 0.071 | — | — | |
| Raw BaselineModel=Whisper-Large (W.L), SNR=5.02026.06 | 0.072 | — | — | |
| Raw BaselineModel=Whisper-Large (W.L), SNR=0.02026.06 | 0.081 | — | — | |
| Raw BaselineModel=Whisper-Large (W.L), SNR=10.02026.06 | 0.085 | — | — | |
| Naive Cohen randomized smoothingModel=Whisper-Large (W.L), SNR=10.02026.06 | 0.087 | 11 | -0.392 | |
| Rank-Based TournamentModel=Whisper-Large (W.L), SNR=10.02026.06 | 0.087 | 38.2 | -0.811 | |
| Raw BaselineModel=Whisper-Small (W.S), SNR=5.02026.06 | 0.088 | — | — | |
| Naive Cohen randomized smoothingModel=Whisper-Small (W.S), SNR=0.02026.06 | 0.11 | 0 | — | |
| Naive Cohen randomized smoothingModel=Whisper-Large (W.L), SNR=-5.02026.06 | 0.125 | 0.5 | -0.154 | |
| Rank-Based TournamentModel=Whisper-Large (W.L), SNR=-5.02026.06 | 0.126 | 74 | -0.123 | |
| Rank-Based TournamentModel=Whisper-Small (W.S), SNR=0.02026.06 | 0.127 | 76.3 | -0.456 | |
| Rank-Based TournamentModel=HuBERT (H), SNR=10.02026.06 | 0.145 | 60.1 | -0.774 | |
| Raw BaselineModel=HuBERT (H), SNR=10.02026.06 | 0.161 | — | — | |
| Naive Cohen randomized smoothingModel=HuBERT (H), SNR=10.02026.06 | 0.162 | 51.3 | -0.747 | |
| Rank-Based TournamentModel=HuBERT (H), SNR=5.02026.06 | 0.205 | 58.7 | -0.731 | |
| Raw BaselineModel=Whisper-Small (W.S), SNR=0.02026.06 | 0.213 | — | — | |
| Naive Cohen randomized smoothingModel=HuBERT (H), SNR=5.02026.06 | 0.217 | 37.2 | -0.756 | |
| Rank-Based TournamentModel=wav2vec Large (W2.L), SNR=10.02026.06 | 0.229 | 72.7 | -0.697 | |
| Raw BaselineModel=HuBERT (H), SNR=5.02026.06 | 0.231 | — | — | |
| Raw BaselineModel=wav2vec Large (W2.L), SNR=10.02026.06 | 0.265 | — | — | |
| Naive Cohen randomized smoothingModel=wav2vec Large (W2.L), SNR=10.02026.06 | 0.272 | 43.3 | -0.71 | |
| Raw BaselineModel=Whisper-Large (W.L), SNR=-5.02026.06 | 0.273 | — | — | |
| Rank-Based TournamentModel=wav2vec Large (W2.L), SNR=5.02026.06 | 0.338 | 71.3 | -0.476 | |
| Naive Cohen randomized smoothingModel=wav2vec Large (W2.L), SNR=5.02026.06 | 0.348 | 20.7 | -0.752 | |
| Raw BaselineModel=wav2vec Large (W2.L), SNR=5.02026.06 | 0.378 | — | — | |
| Rank-Based TournamentModel=HuBERT (H), SNR=0.02026.06 | 0.417 | 80.9 | -0.27 | |
| Naive Cohen randomized smoothingModel=HuBERT (H), SNR=0.02026.06 | 0.436 | 7.7 | -0.7 | |
| Rank-Based TournamentModel=Whisper-Small (W.S), SNR=-5.02026.06 | 0.443 | 44.2 | -0.32 | |
| Raw BaselineModel=HuBERT (H), SNR=0.02026.06 | 0.476 | — | — | |
| Raw BaselineModel=Whisper-Small (W.S), SNR=-5.02026.06 | 0.595 | — | — | |
| Naive Cohen randomized smoothingModel=Whisper-Small (W.S), SNR=-5.02026.06 | 0.669 | 0 | — | |
| Rank-Based TournamentModel=wav2vec Large (W2.L), SNR=0.02026.06 | 0.708 | 70.3 | 0.393 | |
| Naive Cohen randomized smoothingModel=wav2vec Large (W2.L), SNR=0.02026.06 | 0.71 | 2 | -0.617 | |
| Raw BaselineModel=wav2vec Large (W2.L), SNR=0.02026.06 | 0.749 | — | — | |
| Rank-Based TournamentModel=HuBERT (H), SNR=-5.02026.06 | 0.895 | 40.5 | -0.198 | |
| Naive Cohen randomized smoothingModel=HuBERT (H), SNR=-5.02026.06 | 0.925 | 0.7 | -0.298 | |
| Naive Cohen randomized smoothingModel=wav2vec Large (W2.L), SNR=-5.02026.06 | 0.929 | 0 | -0.221 | |
| Rank-Based TournamentModel=wav2vec Large (W2.L), SNR=-5.02026.06 | 0.93 | 45.2 | 0.008 | |
| Raw BaselineModel=HuBERT (H), SNR=-5.02026.06 | 0.94 | — | — | |
| Raw BaselineModel=wav2vec Large (W2.L), SNR=-5.02026.06 | 0.948 | — | — | |
| ROVER (Olivier)Model=Whisper-Large (W.L), SNR=10.02026.06 | 0.97 | 44.3 | -0.844 | |
| ROVER (Olivier)Model=Whisper-Small (W.S), SNR=10.02026.06 | 1.532 | 37.5 | -0.711 | |
| ROVER (Olivier)Model=Whisper-Large (W.L), SNR=5.02026.06 | 1.632 | 32.5 | -0.739 | |
| ROVER (Olivier)Model=Whisper-Small (W.S), SNR=5.02026.06 | 3.917 | 26.2 | -0.613 | |
| ROVER (Olivier)Model=Whisper-Large (W.L), SNR=0.02026.06 | 4.317 | 15.8 | -0.524 | |
| ROVER (Olivier)Model=HuBERT (H), SNR=10.02026.06 | 17.927 | 48 | -0.845 | |
| ROVER (Olivier)Model=Whisper-Small (W.S), SNR=0.02026.06 | 28.143 | 6.7 | -0.372 | |
| ROVER (Olivier)Model=HuBERT (H), SNR=5.02026.06 | 41.904 | 21 | -0.626 | |
| ROVER (Olivier)Model=wav2vec Large (W2.L), SNR=10.02026.06 | 51.548 | 29 | -0.708 | |
| ROVER (Olivier)Model=Whisper-Large (W.L), SNR=-5.02026.06 | 52.577 | 2.1 | -0.242 | |
| ROVER (Olivier)Model=wav2vec Large (W2.L), SNR=-5.02026.06 | 110.595 | 0 | — | |
| ROVER (Olivier)Model=wav2vec Large (W2.L), SNR=5.02026.06 | 155.165 | 10.3 | -0.509 | |
| ROVER (Olivier)Model=HuBERT (H), SNR=-5.02026.06 | 249.886 | 0 | — | |
| ROVER (Olivier)Model=Whisper-Small (W.S), SNR=-5.02026.06 | 258.181 | 0 | — | |
| ROVER (Olivier)Model=HuBERT (H), SNR=0.02026.06 | 258.566 | 2.3 | -0.258 | |
| ROVER (Olivier)Model=wav2vec Large (W2.L), SNR=0.02026.06 | 296.782 | 0.3 | -0.099 |