ASR Error Correction on CommonVoice (test)
5.8WERORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ORACLEBackbone=Llama-3.1 (70B), Reference=Ground truth of NE2025.06 | 5.8 | 83.7 | |
| DeRAGECBackbone=Llama-3.1 (70B), Denoising feature=MCQ + PS + Def + Rat2025.06 | 6 | 83.1 | |
| ORACLEBackbone=gpt-4o-mini, Reference=Ground truth of NE2025.06 | 6 | 82.8 | |
| DeRAGECBackbone=gpt-4o-mini, Denoising feature=MCQ + PS + Def + Rat2025.06 | 6.2 | 81.3 | |
| RAGECBackbone=Llama-3.1 (70B), Denoising feature=N (None)2025.06 | 6.5 | 80.4 | |
| RAGECBackbone=Llama-3.1 (70B), Denoising feature=MCQ2025.06 | 6.5 | 80.4 | |
| RAGECBackbone=Llama-3.1 (70B), Denoising feature=Def2025.06 | 6.5 | 80.7 | |
| RAGECBackbone=Llama-3.1 (70B), Denoising feature=PS + Def2025.06 | 6.5 | 80.7 | |
| RAGECBackbone=Llama-3.1 (70B), Denoising feature=PS2025.06 | 6.6 | 79.6 | |
| RAGECBackbone=gpt-4o-mini, Denoising feature=PS + Def2025.06 | 6.7 | 80.2 | |
| GECBackbone=Llama-3.1 (70B)2025.06 | 6.8 | 78.2 | |
| GECBackbone=gpt-4o-mini2025.06 | 6.9 | 78.4 | |
| RAGECBackbone=gpt-4o-mini, Denoising feature=Def2025.06 | 7 | 79.5 | |
| RAGECBackbone=gpt-4o-mini, Denoising feature=N (None)2025.06 | 7.1 | 78.8 | |
| RAGECBackbone=gpt-4o-mini, Denoising feature=MCQ2025.06 | 7.1 | 78.8 | |
| RAGECBackbone=gpt-4o-mini, Denoising feature=PS2025.06 | 7.1 | 78.5 | |
| ASR onlyBackbone=Llama-3.1 (70B)2025.06 | 7.7 | 75.1 | |
| ASR onlyBackbone=gpt-4o-mini2025.06 | 7.7 | 75.1 |