Automatic Speech Recognition on NKI-RUG-UMCG (patient speakers)
12.9WERWhisper LoRA (+ VTLP)
Evaluation results
| Method | Links | |
|---|---|---|
| Whisper LoRA (+ VTLP)Base Model=Whisper LoRA, Augmentation Strategy=+ VTLP, LLM Correction=GPT-3.5 turbo2026.05 | 12.9 | |
| Whisper (+ XTTS)Base Model=Whisper, Augmentation Strategy=+ XTTS, LLM Correction=GPT-3.5 turbo2026.05 | 12.9 | |
| Whisper LoRA (All speakers)Base Model=Whisper LoRA, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o mini2026.05 | 13.1 | |
| Whisper LoRA (All speakers)Base Model=Whisper LoRA, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-3.5 turbo2026.05 | 13.1 | |
| Whisper LoRA (Patients only)Base Model=Whisper LoRA, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-4o2026.05 | 13.2 | |
| Whisper LoRA (+ VTLP)Base Model=Whisper LoRA, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o2026.05 | 13.2 | |
| Whisper LoRA (All speakers)Base Model=Whisper LoRA, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o2026.05 | 13.3 | |
| Whisper LoRA (Patients only)Base Model=Whisper LoRA, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-3.5 turbo2026.05 | 13.3 | |
| Whisper LoRA (+ Speed perturbation)Base Model=Whisper LoRA, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o mini2026.05 | 13.3 | |
| Whisper LoRA (+ VTLP)Base Model=Whisper LoRA, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o mini2026.05 | 13.3 | |
| Whisper LoRA (+ kNN-VC)Base Model=Whisper LoRA, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-4o mini2026.05 | 13.3 | |
| Whisper LoRA (+ XTTS)Base Model=Whisper LoRA, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o2026.05 | 13.3 | |
| Whisper LoRA (+ Speed perturbation)Base Model=Whisper LoRA, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-3.5 turbo2026.05 | 13.4 | |
| Whisper LoRA (+ kNN-VC)Base Model=Whisper LoRA, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-4o2026.05 | 13.4 | |
| Whisper LoRA (+ kNN-VC)Base Model=Whisper LoRA, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-3.5 turbo2026.05 | 13.4 | |
| Whisper (+ XTTS)Base Model=Whisper, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o mini2026.05 | 13.4 | |
| Whisper LoRA (+ XTTS)Base Model=Whisper LoRA, Augmentation Strategy=+ XTTS, LLM Correction=GPT-3.5 turbo2026.05 | 13.4 | |
| Whisper LoRA (+ XTTS)Base Model=Whisper LoRA, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o mini2026.05 | 13.6 | |
| Whisper LoRA (Patients only)Base Model=Whisper LoRA, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-4o mini2026.05 | 13.7 | |
| Whisper (+ XTTS)Base Model=Whisper, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o2026.05 | 13.8 | |
| Whisper LoRA (+ Time stretching)Base Model=Whisper LoRA, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o mini2026.05 | 13.9 | |
| Whisper LoRA (+ Time stretching)Base Model=Whisper LoRA, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-3.5 turbo2026.05 | 13.9 | |
| Whisper LoRA (+ Speed perturbation)Base Model=Whisper LoRA, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o2026.05 | 13.9 | |
| Whisper LoRA (+ Time stretching)Base Model=Whisper LoRA, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o2026.05 | 14 | |
| Whisper (+ VTLP)Base Model=Whisper, Augmentation Strategy=+ VTLP, LLM Correction=GPT-3.5 turbo2026.05 | 15 | |
| MMS + n-gram (+ XTTS)Base Model=MMS + n-gram, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o2026.05 | 15.1 | |
| Whisper (+ Speed perturbation)Base Model=Whisper, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-3.5 turbo2026.05 | 15.2 | |
| Whisper (+ VTLP)Base Model=Whisper, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o mini2026.05 | 15.2 | |
| Whisper (+ kNN-VC)Base Model=Whisper, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-4o mini2026.05 | 15.2 | |
| Whisper (+ Speed perturbation)Base Model=Whisper, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o2026.05 | 15.3 | |
| Whisper (+ VTLP)Base Model=Whisper, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o2026.05 | 15.3 | |
| Whisper (+ kNN-VC)Base Model=Whisper, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-4o2026.05 | 15.3 | |
| MMS + n-gram (+ XTTS)Base Model=MMS + n-gram, Augmentation Strategy=+ XTTS, LLM Correction=GPT-3.5 turbo2026.05 | 15.3 | |
| MMS + n-gram (+ XTTS)Base Model=MMS + n-gram, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o mini2026.05 | 15.4 | |
| Whisper (Patients only)Base Model=Whisper, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-4o2026.05 | 15.5 | |
| Whisper (Patients only)Base Model=Whisper, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-4o mini2026.05 | 15.5 | |
| Whisper (Patients only)Base Model=Whisper, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-3.5 turbo2026.05 | 15.5 | |
| Whisper (+ Speed perturbation)Base Model=Whisper, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o mini2026.05 | 15.5 | |
| Whisper (+ kNN-VC)Base Model=Whisper, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-3.5 turbo2026.05 | 15.8 | |
| Whisper LoRA (+ VTLP)Base Model=Whisper LoRA, Augmentation Strategy=+ VTLP, LLM Correction=Uncorrected2026.05 | 16.1 | |
| Whisper LoRA (Patients only)Base Model=Whisper LoRA, Augmentation Strategy=Patients only (no augm.), LLM Correction=Uncorrected2026.05 | 16.3 | |
| Whisper LoRA (+ Speed perturbation)Base Model=Whisper LoRA, Augmentation Strategy=+ Speed perturbation, LLM Correction=Uncorrected2026.05 | 16.3 | |
| Whisper LoRA (+ kNN-VC)Base Model=Whisper LoRA, Augmentation Strategy=+ kNN-VC, LLM Correction=Uncorrected2026.05 | 16.3 | |
| Whisper LoRA (+ XTTS)Base Model=Whisper LoRA, Augmentation Strategy=+ XTTS, LLM Correction=Uncorrected2026.05 | 16.4 | |
| Whisper LoRA (All speakers)Base Model=Whisper LoRA, Augmentation Strategy=All speakers (no augm.), LLM Correction=Uncorrected2026.05 | 16.5 | |
| Whisper LoRA (+ Time stretching)Base Model=Whisper LoRA, Augmentation Strategy=+ Time stretching, LLM Correction=Uncorrected2026.05 | 16.5 | |
| MMS + n-gram (All speakers)Base Model=MMS + n-gram, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o2026.05 | 16.7 | |
| MMS + n-gram (All speakers)Base Model=MMS + n-gram, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-3.5 turbo2026.05 | 16.7 | |
| Whisper (All speakers)Base Model=Whisper, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o2026.05 | 16.7 | |
| Whisper (All speakers)Base Model=Whisper, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-3.5 turbo2026.05 | 16.9 | |
| Whisper (All speakers)Base Model=Whisper, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o mini2026.05 | 17.1 | |
| MMS + n-gram (+ Time stretching)Base Model=MMS + n-gram, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-3.5 turbo2026.05 | 17.1 | |
| MMS + n-gram (+ kNN-VC)Base Model=MMS + n-gram, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-3.5 turbo2026.05 | 17.1 | |
| MMS + n-gram (All speakers)Base Model=MMS + n-gram, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o mini2026.05 | 17.3 | |
| MMS + n-gram (+ Time stretching)Base Model=MMS + n-gram, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o2026.05 | 17.3 | |
| MMS + n-gram (+ Time stretching)Base Model=MMS + n-gram, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o mini2026.05 | 17.3 | |
| Whisper (+ Time stretching)Base Model=Whisper, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o mini2026.05 | 17.3 | |
| Whisper (+ Time stretching)Base Model=Whisper, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-3.5 turbo2026.05 | 17.3 | |
| Whisper (+ XTTS)Base Model=Whisper, Augmentation Strategy=+ XTTS, LLM Correction=Uncorrected2026.05 | 17.3 | |
| Whisper (+ Time stretching)Base Model=Whisper, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o2026.05 | 17.4 | |
| MMS + n-gram (+ Speed perturbation)Base Model=MMS + n-gram, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o2026.05 | 17.4 | |
| MMS + n-gram (+ kNN-VC)Base Model=MMS + n-gram, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-4o mini2026.05 | 17.4 | |
| MMS + n-gram (+ Speed perturbation)Base Model=MMS + n-gram, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-3.5 turbo2026.05 | 17.5 | |
| MMS + n-gram (Patients only)Base Model=MMS + n-gram, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-4o mini2026.05 | 17.6 | |
| MMS + n-gram (+ Speed perturbation)Base Model=MMS + n-gram, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o mini2026.05 | 17.6 | |
| MMS + n-gram (+ kNN-VC)Base Model=MMS + n-gram, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-4o2026.05 | 17.6 | |
| MMS (+ XTTS)Base Model=MMS, Augmentation Strategy=+ XTTS, LLM Correction=GPT-3.5 turbo2026.05 | 17.6 | |
| MMS + n-gram (Patients only)Base Model=MMS + n-gram, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-3.5 turbo2026.05 | 17.8 | |
| MMS + n-gram (+ XTTS)Base Model=MMS + n-gram, Augmentation Strategy=+ XTTS, LLM Correction=Uncorrected2026.05 | 17.9 | |
| MMS + n-gram (Patients only)Base Model=MMS + n-gram, Augmentation Strategy=Patients only (no augm.), LLM Correction=GPT-4o2026.05 | 18.1 | |
| MMS + n-gram (+ VTLP)Base Model=MMS + n-gram, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o2026.05 | 18.2 | |
| MMS + n-gram (+ VTLP)Base Model=MMS + n-gram, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o mini2026.05 | 18.2 | |
| MMS (+ XTTS)Base Model=MMS, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o2026.05 | 18.2 | |
| MMS (+ XTTS)Base Model=MMS, Augmentation Strategy=+ XTTS, LLM Correction=GPT-4o mini2026.05 | 18.2 | |
| MMS + n-gram (+ VTLP)Base Model=MMS + n-gram, Augmentation Strategy=+ VTLP, LLM Correction=GPT-3.5 turbo2026.05 | 18.3 | |
| MMS (+ VTLP)Base Model=MMS, Augmentation Strategy=+ VTLP, LLM Correction=GPT-3.5 turbo2026.05 | 18.5 | |
| MMS (+ VTLP)Base Model=MMS, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o2026.05 | 18.8 | |
| MMS (+ VTLP)Base Model=MMS, Augmentation Strategy=+ VTLP, LLM Correction=GPT-4o mini2026.05 | 19.1 | |
| MMS + n-gram (All speakers)Base Model=MMS + n-gram, Augmentation Strategy=All speakers (no augm.), LLM Correction=Uncorrected2026.05 | 19.3 | |
| MMS (+ Time stretching)Base Model=MMS, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o2026.05 | 19.4 | |
| MMS (+ Speed perturbation)Base Model=MMS, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-3.5 turbo2026.05 | 19.4 | |
| MMS + n-gram (+ Time stretching)Base Model=MMS + n-gram, Augmentation Strategy=+ Time stretching, LLM Correction=Uncorrected2026.05 | 19.5 | |
| Whisper (+ Speed perturbation)Base Model=Whisper, Augmentation Strategy=+ Speed perturbation, LLM Correction=Uncorrected2026.05 | 19.5 | |
| Whisper (Patients only)Base Model=Whisper, Augmentation Strategy=Patients only (no augm.), LLM Correction=Uncorrected2026.05 | 19.6 | |
| MMS (+ Speed perturbation)Base Model=MMS, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o mini2026.05 | 19.6 | |
| MMS (All speakers)Base Model=MMS, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o2026.05 | 19.7 | |
| MMS (+ Speed perturbation)Base Model=MMS, Augmentation Strategy=+ Speed perturbation, LLM Correction=GPT-4o2026.05 | 19.7 | |
| Whisper (+ kNN-VC)Base Model=Whisper, Augmentation Strategy=+ kNN-VC, LLM Correction=Uncorrected2026.05 | 19.7 | |
| MMS (All speakers)Base Model=MMS, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-4o mini2026.05 | 19.8 | |
| Whisper (+ VTLP)Base Model=Whisper, Augmentation Strategy=+ VTLP, LLM Correction=Uncorrected2026.05 | 19.8 | |
| MMS (+ kNN-VC)Base Model=MMS, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-4o2026.05 | 19.8 | |
| MMS + n-gram (+ Speed perturbation)Base Model=MMS + n-gram, Augmentation Strategy=+ Speed perturbation, LLM Correction=Uncorrected2026.05 | 19.9 | |
| MMS + n-gram (+ VTLP)Base Model=MMS + n-gram, Augmentation Strategy=+ VTLP, LLM Correction=Uncorrected2026.05 | 19.9 | |
| MMS (All speakers)Base Model=MMS, Augmentation Strategy=All speakers (no augm.), LLM Correction=GPT-3.5 turbo2026.05 | 20 | |
| MMS (+ Time stretching)Base Model=MMS, Augmentation Strategy=+ Time stretching, LLM Correction=GPT-4o mini2026.05 | 20.1 | |
| MMS (+ kNN-VC)Base Model=MMS, Augmentation Strategy=+ kNN-VC, LLM Correction=GPT-3.5 turbo2026.05 | 20.1 | |
| MMS + n-gram (Patients only)Base Model=MMS + n-gram, Augmentation Strategy=Patients only (no augm.), LLM Correction=Uncorrected2026.05 | 20.3 | |
| WhisperBase Model=Whisper, Augmentation Strategy=No finetuning, LLM Correction=GPT-4o mini2026.05 | 20.6 | |
| Whisper LoRABase Model=Whisper LoRA, Augmentation Strategy=No finetuning, LLM Correction=GPT-4o mini2026.05 | 20.6 | |
| MMS + n-gram (+ kNN-VC)Base Model=MMS + n-gram, Augmentation Strategy=+ kNN-VC, LLM Correction=Uncorrected2026.05 | 20.6 |