ASR rescoring on LibriSpeech (dev-clean)
4.61WERTranscormer (base, 20K steps)
Evaluation results
| Method | Links | |
|---|---|---|
| Transcormer (base, 20K steps)Domain=Libri, Steps=20K2022.05 | 4.61 | |
| T-TADomain=Libri2022.05 | 4.98 | |
| RoBERTa (base)Domain=ROBERTa [13]2022.05 | 5.03 | |
| Transcormer (base)Domain=wikibooks2022.05 | 5.09 | |
| Transcormer (+ BERT Init)Domain=wikibooks, Steps=20K, Initialization=BERT2022.05 | 5.1 | |
| GPT-2 (345M)Domain=openwebtext, Parameters=345M2022.05 | 5.15 | |
| BERT (base)Domain=wikibooks2022.05 | 5.17 | |
| GPT-2 (117M)Domain=openwebtext, Parameters=117M2022.05 | 5.39 | |
| BaselineDomain=N/A2022.05 | 7.17 |