ASR Error Correction on Common Voice Frisian (test)
8.9WERGPT-5.1
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-5.1Approach=Generative (GER), Prompting=3-shot2026.05 | 8.9 | |
| GPT-5.1Approach=Generative (GER), Prompting=5-shot2026.05 | 8.9 | |
| GPT-5.1Approach=Generative (GER), Prompting=10-shot2026.05 | 9 | |
| GPT-5.1Approach=Generative (GER), Prompting=1-shot2026.05 | 9.5 | |
| XLS-R - oracleApproach=Baseline (Five-best list minimum)2026.05 | 9.6 | |
| GPT-5.1Approach=Generative (GER), Prompting=0-shot2026.05 | 10.1 | |
| XLS-R - trigramApproach=Baseline (Conventional LM)2026.05 | 12.1 | |
| GPT-5.1Approach=Selection-based2026.05 | 12.1 | |
| GPT-4o-miniApproach=Generative (GER), Prompting=3-shot2026.05 | 12.2 | |
| GPT-4o-miniApproach=Generative (GER), Prompting=1-shot2026.05 | 12.4 | |
| GPT-4o-miniApproach=Generative (GER), Prompting=10-shot2026.05 | 12.4 | |
| GPT-4o-miniApproach=Generative (GER), Prompting=0-shot2026.05 | 12.5 | |
| GPT-4o-miniApproach=Generative (GER), Prompting=5-shot2026.05 | 12.5 | |
| GPT-4o-miniApproach=Selection-based2026.05 | 12.8 | |
| Qwen3-FTApproach=Generative (GER), Prompting=3-shot2026.05 | 13.4 | |
| Qwen3-FTApproach=Generative (GER), Prompting=10-shot2026.05 | 13.4 | |
| XLS-RApproach=ASR Baseline2026.05 | 13.5 | |
| Qwen3-FTApproach=Selection-based2026.05 | 13.5 | |
| Qwen3-FTApproach=Generative (GER), Prompting=0-shot2026.05 | 13.5 | |
| Qwen3-FTApproach=Generative (GER), Prompting=1-shot2026.05 | 13.5 | |
| Qwen3-FTApproach=Generative (GER), Prompting=5-shot2026.05 | 13.5 | |
| Qwen3Approach=Generative (GER), Prompting=3-shot2026.05 | 13.8 | |
| Qwen3Approach=Generative (GER), Prompting=5-shot2026.05 | 13.9 | |
| Qwen3Approach=Generative (GER), Prompting=10-shot2026.05 | 13.9 | |
| Qwen3Approach=Generative (GER), Prompting=1-shot2026.05 | 14.1 | |
| Qwen3Approach=Generative (GER), Prompting=0-shot2026.05 | 14.4 | |
| Qwen3Approach=Selection-based2026.05 | 14.7 |