# Automatic Speech Recognition on WAXAL (test) Source: [Automatic Speech Recognition on WAXAL (test)]() Collection index: [llms.txt]() Data updated: 2026-03-26T13:37:23.287Z Evaluation of Automatic Speech Recognition performance on the test split of the WAXAL dataset, reporting language-specific metrics (Amharic, Tigrinya, Oromo, Wolaytta, Sidaama) and an average. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Automatic Speech Recognition | | Dataset (including any stated split) | WAXAL (test) | | Metric | Amharic ASR Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Amharic ASR Score](): Higher is better; unit: SCALAR. - [Tigrinya ASR Score](): Higher is better; unit: SCALAR. - [Oromo ASR Score](): Higher is better; unit: SCALAR. - [Wolaytta ASR Score](): Higher is better; unit: SCALAR. - [Sidaama ASR Score](): Higher is better; unit: SCALAR. - [Average ASR Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | Amharic ASR Score | Result date | Report paper | | --- | --- | --- | --- | | whisper-medium | 195.05 | Not recorded | 69c4bd6b0636e5bf4afc748e | | whisper-small | 157.85 | Not recorded | 69c4bd6b0636e5bf4afc748e | | whisper-large-v3 | 153.03 | Not recorded | 69c4bd6b0636e5bf4afc748e | | seamless-m4t-v2-large | 103.75 | Not recorded | 69c4bd6b0636e5bf4afc748e | | mms-1b-all | 57.53 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-ctc-300m-v2 | 49.15 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-ctc-1b-v2 | 37.44 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-ctc-7b-v2 | 32.48 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-ctc-3b-v2 | 32.41 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-llm-300m-v2 | 30.95 | Not recorded | 69c4bd6b0636e5bf4afc748e | | Ethio-ASR (afrihubert) | 30.95 | Not recorded | 69c4bd6b0636e5bf4afc748e | | Ethio-ASR (mms-300) | 30.19 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-llm-1b-v2 | 27.65 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-llm-3b-v2 | 26.83 | Not recorded | 69c4bd6b0636e5bf4afc748e | | Ethio-ASR (mms-1b) | 26.14 | Not recorded | 69c4bd6b0636e5bf4afc748e | | omniASR-llm-7b-v2 | 25.12 | Not recorded | 69c4bd6b0636e5bf4afc748e | | Ethio-ASR (w2v-bert-2.0) | 22.92 | Not recorded | 69c4bd6b0636e5bf4afc748e | | monolingual SFT (w2v-bert-2.0) | 22.37 | Not recorded | 69c4bd6b0636e5bf4afc748e | ### whisper-medium Amharic ASR Score: 195.05. Result ID: 69c5354f47f34ce924aec8f1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# params":"786M","Decoder":"LM"}. This record does not assert independent reproduction. ### whisper-small Amharic ASR Score: 157.85. Result ID: 69c5354f47f34ce924aec8f0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# params":"300M","Decoder":"LM"}. This record does not assert independent reproduction. ### whisper-large-v3 Amharic ASR Score: 153.03. Result ID: 69c5354f47f34ce924aec8f2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"# params":"1.6B","Decoder":"LM"}. This record does not assert independent reproduction. ### seamless-m4t-v2-large Amharic ASR Score: 103.75. Result ID: 69c5354f47f34ce924aec8f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"2B","Decoder":"LM"}. This record does not assert independent reproduction. ### mms-1b-all Amharic ASR Score: 57.53. Result ID: 69c5354f47f34ce924aec8f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"1B","Decoder":"CTC"}. This record does not assert independent reproduction. ### omniASR-ctc-300m-v2 Amharic ASR Score: 49.15. Result ID: 69c5354f47f34ce924aec8f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"300M","Decoder":"CTC"}. This record does not assert independent reproduction. ### omniASR-ctc-1b-v2 Amharic ASR Score: 37.44. Result ID: 69c5354f47f34ce924aec8f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"1B","Decoder":"CTC"}. This record does not assert independent reproduction. ### omniASR-ctc-7b-v2 Amharic ASR Score: 32.48. Result ID: 69c5354f47f34ce924aec8f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"7B","Decoder":"CTC"}. This record does not assert independent reproduction. ### omniASR-ctc-3b-v2 Amharic ASR Score: 32.41. Result ID: 69c5354f47f34ce924aec8f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"3B","Decoder":"CTC"}. This record does not assert independent reproduction. ### omniASR-llm-300m-v2 Amharic ASR Score: 30.95. Result ID: 69c5354f47f34ce924aec8f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"300M","Decoder":"LLM"}. This record does not assert independent reproduction. ### Ethio-ASR (afrihubert) Amharic ASR Score: 30.95. Result ID: 69c5354f47f34ce924aec8fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"94M","Decoder":"CTC"}. This record does not assert independent reproduction. ### Ethio-ASR (mms-300) Amharic ASR Score: 30.19. Result ID: 69c5354f47f34ce924aec8fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"300M","Decoder":"CTC"}. This record does not assert independent reproduction. ### omniASR-llm-1b-v2 Amharic ASR Score: 27.65. Result ID: 69c5354f47f34ce924aec8fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"1B","Decoder":"LLM"}. This record does not assert independent reproduction. ### omniASR-llm-3b-v2 Amharic ASR Score: 26.83. Result ID: 69c5354f47f34ce924aec8fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"3B","Decoder":"LLM"}. This record does not assert independent reproduction. ### Ethio-ASR (mms-1b) Amharic ASR Score: 26.14. Result ID: 69c5354f47f34ce924aec8ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"1B","Decoder":"CTC"}. This record does not assert independent reproduction. ### omniASR-llm-7b-v2 Amharic ASR Score: 25.12. Result ID: 69c5354f47f34ce924aec8fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"7B","Decoder":"LLM"}. This record does not assert independent reproduction. ### Ethio-ASR (w2v-bert-2.0) Amharic ASR Score: 22.92. Result ID: 69c5354f47f34ce924aec900. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"600M","Decoder":"CTC"}. This record does not assert independent reproduction. ### monolingual SFT (w2v-bert-2.0) Amharic ASR Score: 22.37. Result ID: 69c5354f47f34ce924aec901. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"# params":"5×600M","Decoder":"CTC"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.