Automatic Speech Recognition on Kina Rutul (evaluation)
0.697Word Error Rate (WER)w2v2l-custom-avg-lm
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| w2v2l-custom-avg-lmParams.=0.3B, Tunable=0.3B2026.04 | 0.697 | 0.206 | 0.206 | |
| w2v2l-custom-avgParams.=0.3B, Tunable=0.3B2026.04 | 0.725 | 0.198 | 0.195 | |
| w2v2l-custom-cpy1Params.=0.3B, Tunable=0.3B2026.04 | 0.738 | 0.205 | 0.203 | |
| whisper-large-v3Params.=1.5B, Tunable=1.5B2026.04 | 0.778 | 0.253 | 0.251 | |
| Qwen2-Audio-7B-InstructParams.=8.4B, Tunable=0.7B2026.04 | 0.778 | 0.242 | 0.239 | |
| w2v2l-customParams.=0.3B, Tunable=0.3B2026.04 | 0.78 | 0.224 | 0.222 | |
| whisper-large-v3-cyrlParams.=1.5B, Tunable=1.5B2026.04 | 0.792 | 0.232 | 0.235 | |
| wav2vec2-large-ipaParams.=0.3B, Tunable=0.3B2026.04 | 0.795 | 0.223 | 0.22 | |
| Qwen2-Audio-7B-Instruct-cyrlParams.=8.4B, Tunable=0.7B2026.04 | 0.828 | 0.272 | 0.274 | |
| Qwen2.5-Omni-7BParams.=10.8B, Tunable=0.7B2026.04 | 0.852 | 0.263 | 0.257 | |
| Qwen2.5-Omni-7B-cyrlParams.=10.8B, Tunable=0.7B2026.04 | 0.904 | 0.295 | 0.291 | |
| gpt-4o-transcribeParams.=-, Tunable=-2026.04 | 0.994 | 0.519 | 0.514 | |
| wav2vec2-large-ipa-zsParams.=0.3B, Tunable=-2026.04 | 1 | 0.656 | 0.66 | |
| w2v2l-custom-avg-zsParams.=0.3B, Tunable=-2026.04 | 1 | 0.563 | 0.571 |