Automatic Speech Recognition on WAXAL (test)
195.05Amharic ASR Scorewhisper-medium
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| whisper-medium# params=786M, Decoder=LM2026.03 | 195.05 | 198.06 | 192.64 | 247.3 | 232.91 | 213.19 | |
| whisper-small# params=300M, Decoder=LM2026.03 | 157.85 | 174.31 | 152.99 | 184.67 | 182.32 | 170.43 | |
| whisper-large-v3# params=1.6B, Decoder=LM2026.03 | 153.03 | 166.2 | 128.65 | 151.04 | 144.08 | 148.6 | |
| seamless-m4t-v2-large# params=2B, Decoder=LM2026.03 | 103.75 | 100 | 100 | 100 | 100 | 100.75 | |
| mms-1b-all# params=1B, Decoder=CTC2026.03 | 57.53 | 70.48 | 41.53 | 104.22 | 37.64 | 62.28 | |
| omniASR-ctc-300m-v2# params=300M, Decoder=CTC2026.03 | 49.15 | 58.11 | 40.77 | 52.9 | 41.08 | 48.4 | |
| omniASR-ctc-1b-v2# params=1B, Decoder=CTC2026.03 | 37.44 | 50.15 | 31.34 | 46.35 | 37.26 | 40.51 | |
| omniASR-ctc-7b-v2# params=7B, Decoder=CTC2026.03 | 32.48 | 46.21 | 27.79 | 44.58 | 35.21 | 37.26 | |
| omniASR-ctc-3b-v2# params=3B, Decoder=CTC2026.03 | 32.41 | 45.91 | 27.91 | 43.44 | 35.38 | 37.01 | |
| omniASR-llm-300m-v2# params=300M, Decoder=LLM2026.03 | 30.95 | 46.1 | 27.33 | 41.43 | 34.1 | 35.98 | |
| Ethio-ASR (afrihubert)# params=94M, Decoder=CTC2026.03 | 30.95 | 42.42 | 27.57 | 40.44 | 34.02 | 35.08 | |
| Ethio-ASR (mms-300)# params=300M, Decoder=CTC2026.03 | 30.19 | 41.62 | 26.41 | 39.1 | 32.66 | 33.99 | |
| omniASR-llm-1b-v2# params=1B, Decoder=LLM2026.03 | 27.65 | 42.87 | 25.28 | 40.37 | 33.21 | 33.88 | |
| omniASR-llm-3b-v2# params=3B, Decoder=LLM2026.03 | 26.83 | 42.32 | 24.8 | 40.36 | 32.91 | 33.48 | |
| Ethio-ASR (mms-1b)# params=1B, Decoder=CTC2026.03 | 26.14 | 37.63 | 23.69 | 37.51 | 31.02 | 31.2 | |
| omniASR-llm-7b-v2# params=7B, Decoder=LLM2026.03 | 25.12 | 40.69 | 23.59 | 39.22 | 32.46 | 32.21 | |
| Ethio-ASR (w2v-bert-2.0)# params=600M, Decoder=CTC2026.03 | 22.92 | 35.22 | 24.44 | 38.19 | 31.65 | 30.48 | |
| monolingual SFT (w2v-bert-2.0)# params=5×600M, Decoder=CTC2026.03 | 22.37 | 35.65 | 24.29 | 37.64 | 30.04 | 30 |