List your company
ResearchFormerly WizWand

Automatic Speech Recognition on CHiME-4 simu (test)

4.94WERWER-OA
3.214814.859926.50538.1501May 9, 2019Jun 25, 2020Aug 13, 2021Oct 1, 2022Nov 19, 2023Jan 6, 2025Feb 24, 2026
Updated 4mo ago

Evaluation results

MethodLinks
WER-OAASR Model=Parakeet, SE System=Demucs2026.024.94
WER-OAASR Model=Whisper, SE System=Demucs2026.025.05
Noisy yASR Model=Parakeet, SE System=None2026.025.24
Noisy yASR Model=Whisper, SE System=None2026.025.36
Conf-OAASR Model=Parakeet, SE System=Demucs2026.025.4
Classifier-OA_3classASR Model=Parakeet, SE System=Demucs2026.025.48
Conf-SwitchASR Model=Parakeet, SE System=Demucs2026.025.58
Conf-OAASR Model=Whisper, SE System=Demucs2026.025.64
Classifier-OA_3classASR Model=Whisper, SE System=Demucs2026.025.7
Conf-SwitchASR Model=Whisper, SE System=Demucs2026.025.76
DNSMOS-OAASR Model=Parakeet, SE System=Demucs2026.026.66
DNSMOS-OAASR Model=Whisper, SE System=Demucs2026.026.82
IRTFpost-filter=Wiener2019.056.95
Classifier-OA_2classASR Model=Parakeet, SE System=Demucs2026.027.35
IRTFpost-filter=none2019.057.36
MVDRpost-filter=Wiener2019.057.47
GEVpost-filter=BAN2019.057.94
MVDRpost-filter=none2019.057.97
Classifier-OA_2classASR Model=Whisper, SE System=Demucs2026.028.16
Whisper (real label)Adaptation strategy=Finetuning, Supervision type=Supervised2024.058.7
STARAdaptation strategy=STAR, Supervision type=Unsupervised2024.059.4
TOKreweight (A_t)Adaptation strategy=Self-training, Token-level re-weighting=A_t, Supervision type=Unsupervised2024.059.5
UTTfilterAdaptation strategy=Self-training, Filtering=Utterance-level, Supervision type=Unsupervised2024.059.7
TOKreweight (G_t)Adaptation strategy=Self-training, Token-level re-weighting=G_t, Supervision type=Unsupervised2024.059.8
Whisper (frozen)Adaptation strategy=None, Supervision type=Zero-shot2024.059.9
Whisper (self-train.)Adaptation strategy=Self-training, Supervision type=Unsupervised2024.0510.1
GEVpost-filter=none2019.0510.27
Unprocessedpost-filter=none2019.0510.79
WER-OAASR Model=Wav2Vec2, SE System=Demucs2026.0221.91
Conf-OAASR Model=Wav2Vec2, SE System=Demucs2026.0222.87
Classifier-OA_3classASR Model=Wav2Vec2, SE System=Demucs2026.0223.08
DNSMOS-OAASR Model=Wav2Vec2, SE System=Demucs2026.0225.2
Conf-SwitchASR Model=Wav2Vec2, SE System=Demucs2026.0225.76
Noisy yASR Model=Wav2Vec2, SE System=None2026.0225.82
Enhanced x_hatASR Model=Parakeet, SE System=Demucs2026.0227.42
Classifier-OA_2classASR Model=Wav2Vec2, SE System=Demucs2026.0228.31
Enhanced x_hatASR Model=Whisper, SE System=Demucs2026.0228.69
Enhanced x_hatASR Model=Wav2Vec2, SE System=Demucs2026.0248.07