ASR on CV 8.0 (test)
8CERWhisper-large-v3
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Whisper-large-v3Model params.=1,541M, Beam size=52023.12 | 8 | 0.46 | |
| Whisper-large-v3Model params.=1,541M, Beam size=12023.12 | 8.2 | 0.3 | |
| reazonspeech-espnet-v1Model params.=90M, Beam size=202023.12 | 8.9 | 0.27 | |
| reazonspeech-espnet-v1Model params.=90M, Beam size=52023.12 | 9 | 0.2 | |
| Nue-ASRModel params.=3,708M, Beam size=1, DeepSpeed-Inference=false2023.12 | 9.1 | 0.22 | |
| Whisper-large-v2Model params.=1,541M, Beam size=52023.12 | 9.2 | 0.49 | |
| Nue-ASRModel params.=3,708M, Beam size=1, DeepSpeed-Inference=true2023.12 | 9.2 | 0.15 | |
| Whisper-large-v2Model params.=1,541M, Beam size=12023.12 | 9.4 | 0.31 | |
| reazonspeech-espnet-v1Model params.=90M, Beam size=12023.12 | 10.5 | 0.06 | |
| Whisper-mediumModel params.=769M, Beam size=52023.12 | 10.7 | 0.28 | |
| Whisper-mediumModel params.=769M, Beam size=12023.12 | 10.8 | 0.21 | |
| Whisper-smallModel params.=244M, Beam size=52023.12 | 13.9 | 0.14 | |
| Whisper-smallModel params.=244M, Beam size=12023.12 | 14.9 | 0.1 | |
| Whisper-baseModel params.=74M, Beam size=52023.12 | 23.6 | 0.08 | |
| Whisper-baseModel params.=74M, Beam size=12023.12 | 25.7 | 0.06 |