ASR Hypothesis Selection on Khinalug (test)
36.5WEROracle
Evaluation Results
| Method | Links | |
|---|---|---|
| OracleDescription=Selection of best hypothesis by lowest WER against ground truth2026.01 | 36.5 | |
| Ngram-LMModel Category=Text-based LLM2026.01 | 39.6 | |
| Qwen3-OmniModel Category=Multimodal LLM2026.01 | 40.7 | |
| Phi-4 TFTModel Category=Multimodal LLM, Fine-tuning Protocol=Target-language fine-tuning2026.01 | 40.8 | |
| Phi-4 XFTModel Category=Multimodal LLM, Fine-tuning Protocol=Cross-lingual fine-tuning2026.01 | 41 | |
| Phi-4Model Category=Multimodal LLM, Fine-tuning Protocol=None2026.01 | 41.5 | |
| Trans-LMModel Category=Text-based LLM2026.01 | 41.6 | |
| LlamaModel Category=Text-based LLM, Variant=Llama3B2026.01 | 41.9 | |
| AcousticModel Category=Acoustic baseline2026.01 | 42.1 |