ASR Error Correction on MMLU (test)
76.7Clinical AccuracyZS-ASR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ZS-ASRDescription=Zero-shot Whisper raw transcript, Fine-tuned=false, KG Context=false2026.02 | 76.7 | 87 | 67.5 | 78.9 | 61.9 | |
| FT+WhispDescription=Fine-Tuned LLM with Whisper transcript, Fine-tuned=true, KG Context=false2026.02 | 27.3 | 25.8 | 21 | 24.6 | 39.3 | |
| MedSpeakDescription=Proposed model with budgeted KG context and fine-tuned LLM, Fine-tuned=true, KG Context=true2026.02 | 22.1 | 19.8 | 15.7 | 17.5 | 37.8 |