Automatic Speech Recognition on WAXAL (Full)
254.3Amharic PerformanceWhisper L
Evaluation results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Whisper LEvaluation Protocol=Zero-shot (ZS)2026.06 | 254.3 | — | — | — | — | — | — | — | 93 | — | 132 | — | — | — | 112.4 | — | — | — | — | — | |
| MMS-1BEvaluation Protocol=Zero-shot (ZS)2026.06 | 100.7 | 80.5 | 99 | 76.1 | 82 | 88.7 | 63.6 | 103.1 | 44.7 | 32.1 | 55.5 | 96.7 | 78.3 | 26.6 | 36.9 | 84.9 | 70.4 | 109 | 90.6 | 74.7 | |
| Omni.Evaluation Protocol=Zero-shot (ZS)2026.06 | 51.1 | 75.8 | 59.9 | 70.4 | 79.2 | 79.3 | 60.6 | 93.3 | 45.3 | 42.9 | 40.4 | 71.9 | 59.9 | 46 | 35.6 | 75.6 | 68.6 | 82.4 | 95.7 | 64.9 | |
| Whisp. TEvaluation Protocol=Fine-tuned (FT)2026.06 | 41.3 | 57.7 | 37.9 | 37.3 | 39.5 | 35.5 | 35.5 | 80.9 | 49 | 33.8 | 17.7 | 59.6 | 46.7 | 29.3 | 31.4 | 34.4 | 69 | 60.3 | 42.6 | 44.2 | |
| MMS-300MEvaluation Protocol=Fine-tuned (FT)2026.06 | 37.8 | 42.3 | 34.2 | 34.9 | 35 | 31.3 | 40.6 | 75.3 | 42.6 | 16.9 | 12.8 | 49.5 | 38.6 | 26.9 | 25 | 35.6 | 47.2 | 57.1 | 38.8 | 38 | |
| Whisp. SEvaluation Protocol=Fine-tuned (FT)2026.06 | 33.6 | 42.3 | 31.7 | 34 | 34 | 32.3 | 42.6 | 77.5 | 42.7 | 21.6 | 13.1 | 75.5 | 44.7 | 25.2 | 26.9 | 30.1 | 57.1 | 53.5 | 39.5 | 39.9 |