Spoken Medical Question Answering on MedMCQA (test)
92.5QA AccuracyFine-Tuned LLM + GT (FT-LLM)
Evaluation results
| Method | Links | |
|---|---|---|
| Fine-Tuned LLM + GT (FT-LLM)Transcription Source=Ground truth texts, Fine-tuning Status=Fully fine-tuned, Knowledge Graph Context Integration=No KG-context2026.02 | 92.5 | |
| MedSpeakTranscription Source=Whisper generated transcripts, Fine-tuning Status=Fine-tuned, Knowledge Graph Context Integration=Budgeted KG context2026.02 | 91.5 | |
| Fine-Tuned LLM + Whisper (FT+Whisp)Transcription Source=Whisper generated transcripts, Fine-tuning Status=Fine-tuned, Knowledge Graph Context Integration=No KG-context2026.02 | 82.3 | |
| Zero-shot GT (Zero-Shot)Transcription Source=Ground truth transcripts, Fine-tuning Status=No fine-tuning, Knowledge Graph Context Integration=No KG-context2026.02 | 52.8 | |
| Zero-shot ASR (ZS-ASR)Transcription Source=Whisper generated transcript, Fine-tuning Status=No fine-tuning, Knowledge Graph Context Integration=No KG-context2026.02 | 45.5 |