Automatic Speech Recognition on Yodas (test)
5.9WERContext biasing + text replacement oracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Context biasing + text replacement oracleDistractors=No2025.06 | 5.9 | 13.2 | 5.7 | |
| Context biasing + text replacement oracleDistractors=Yes2025.06 | 6.2 | 14.5 | 6 | |
| Context biasing + text replacement + replacementDistractors=No, Number of replacements=12025.06 | 6.3 | 24.5 | 5.9 | |
| Context biasing + text replacement + replacementDistractors=No, Number of replacements=22025.06 | 6.3 | 21.6 | 6 | |
| Context biasing + text replacement + replacementDistractors=No, Number of replacements=32025.06 | 6.3 | 21.6 | 6 | |
| Context biasing + text replacement + replacementDistractors=No, Number of replacements=42025.06 | 6.3 | 21.6 | 6 | |
| Context biasing + replacementDistractors=No, Number of replacements=22025.06 | 6.4 | 27.2 | 6 | |
| Context biasing + replacementDistractors=No, Number of replacements=32025.06 | 6.4 | 26.9 | 6 | |
| Context biasing + replacementDistractors=No, Number of replacements=42025.06 | 6.4 | 26.9 | 6 | |
| Context biasing + text replacement + replacementDistractors=Yes, Number of replacements=22025.06 | 6.4 | 21.4 | 6.1 | |
| Context biasing + text replacement + replacementDistractors=Yes, Number of replacements=32025.06 | 6.4 | 21.4 | 6.1 | |
| Context biasing + text replacement + replacementDistractors=Yes, Number of replacements=42025.06 | 6.4 | 21.4 | 6.1 | |
| Context biasing + text replacementDistractors=No, Number of replacements=32025.06 | 6.5 | 34.6 | 5.9 | |
| Context biasing + text replacementDistractors=No, Number of replacements=42025.06 | 6.5 | 34.6 | 5.9 | |
| Context biasing + replacementDistractors=No, Number of replacements=12025.06 | 6.5 | 30.6 | 6 | |
| Context biasing + text replacementDistractors=No, Number of replacements=22025.06 | 6.6 | 36.9 | 6 | |
| Context biasing + replacementDistractors=Yes, Number of replacements=22025.06 | 6.6 | 28 | 6.2 | |
| Context biasing + replacementDistractors=Yes, Number of replacements=32025.06 | 6.6 | 27.7 | 6.1 | |
| Context biasing + replacementDistractors=Yes, Number of replacements=42025.06 | 6.6 | 27.7 | 6.1 | |
| Context biasing + text replacement + replacementDistractors=Yes, Number of replacements=12025.06 | 6.6 | 26.4 | 6.2 | |
| Context biasing + text replacementDistractors=No, Number of replacements=12025.06 | 6.8 | 46.2 | 6 | |
| Context biasing + text replacementDistractors=Yes, Number of replacements=22025.06 | 6.8 | 38.3 | 6.2 | |
| Context biasing + text replacementDistractors=Yes, Number of replacements=32025.06 | 6.8 | 35.9 | 6.2 | |
| Context biasing + text replacementDistractors=Yes, Number of replacements=42025.06 | 6.8 | 35.6 | 6.2 | |
| Context biasing + replacementDistractors=Yes, Number of replacements=12025.06 | 6.8 | 34.3 | 6.2 | |
| Context biasing + text replacementDistractors=Yes, Number of replacements=12025.06 | 7.1 | 47 | 6.3 | |
| Context biasingDistractors=No2025.06 | 7.8 | 82.8 | 6.4 | |
| Context biasingDistractors=Yes2025.06 | 8.1 | 83.6 | 6.6 | |
| ASR + DLMSystem=ASR + DLM2025.12 | 11.78 | — | — | |
| ASR onlySystem=ASR only2025.12 | 12.24 | — | — | |
| ASR + LMSystem=ASR + LM2025.12 | 12.89 | — | — |