ASR rescoring on LibriSpeech (test-other)
10.3WERMATE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MATEAlignment Loss=Contrastive2023.05 | 10.3 | 13.81 | |
| MATE-MSEAlignment Loss=MSE2023.05 | 10.31 | 13.97 | |
| BERT-text2023.05 | 10.33 | 14.45 | |
| MATE-NAAlignment Loss=None2023.05 | 10.75 | 14.51 | |
| ME-adapterParameter-Efficient Tuning=true2023.05 | 10.79 | 14.63 | |
| WavLM-adapterParameter-Efficient Tuning=true2023.05 | 10.81 | 14.69 | |
| Frozen-MEParameter-Efficient Tuning=true2023.05 | 10.82 | 14.65 | |
| GPT2-text2023.05 | 11.06 | 15.11 | |
| Multi-modal-GPT22023.05 | 11.54 | 14.93 | |
| LAS rescoring2023.05 | 11.97 | 15.59 | |
| No rescoring2023.05 | 11.98 | 15.61 | |
| Transcormer (base, 20K steps)Domain=Libri, Steps=20K2022.05 | 16.45 | — | |
| T-TADomain=Libri2022.05 | 16.91 | — | |
| RoBERTa (base)Domain=ROBERTa [13]2022.05 | 17.18 | — | |
| Transcormer (+ BERT Init)Domain=wikibooks, Steps=20K, Initialization=BERT2022.05 | 17.2 | — | |
| GPT-2 (345M)Domain=openwebtext, Parameters=345M2022.05 | 17.26 | — | |
| Transcormer (base)Domain=wikibooks2022.05 | 17.31 | — | |
| BERT (base)Domain=wikibooks2022.05 | 17.41 | — | |
| ElectricDomain=wikibooks2022.05 | 17.42 | — | |
| GPT-2 (117M)Domain=openwebtext, Parameters=117M2022.05 | 17.6 | — | |
| BaselineDomain=N/A2022.05 | 20.37 | — |