List your company
ResearchFormerly WizWand

ASR rescoring on LibriSpeech (test-other)

10.3WERMATE
9.897212.616115.33518.0539May 25, 2022Jul 22, 2022Sep 19, 2022Nov 16, 2022Jan 14, 2023Mar 13, 2023May 11, 2023
Updated 8mo ago

Evaluation results

MethodLinks
MATEAlignment Loss=Contrastive2023.0510.313.81
MATE-MSEAlignment Loss=MSE2023.0510.3113.97
BERT-text2023.0510.3314.45
MATE-NAAlignment Loss=None2023.0510.7514.51
ME-adapterParameter-Efficient Tuning=true2023.0510.7914.63
WavLM-adapterParameter-Efficient Tuning=true2023.0510.8114.69
Frozen-MEParameter-Efficient Tuning=true2023.0510.8214.65
GPT2-text2023.0511.0615.11
Multi-modal-GPT22023.0511.5414.93
LAS rescoring2023.0511.9715.59
No rescoring2023.0511.9815.61
Transcormer (base, 20K steps)Domain=Libri, Steps=20K2022.0516.45—
T-TADomain=Libri2022.0516.91—
RoBERTa (base)Domain=ROBERTa [13]2022.0517.18—
Transcormer (+ BERT Init)Domain=wikibooks, Steps=20K, Initialization=BERT2022.0517.2—
GPT-2 (345M)Domain=openwebtext, Parameters=345M2022.0517.26—
Transcormer (base)Domain=wikibooks2022.0517.31—
BERT (base)Domain=wikibooks2022.0517.41—
ElectricDomain=wikibooks2022.0517.42—
GPT-2 (117M)Domain=openwebtext, Parameters=117M2022.0517.6—
BaselineDomain=N/A2022.0520.37—