Automatic Speech Recognition on ATCOSIM
20.72WERASTRA ASR Pipeline
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ASTRA ASR PipelineParams=1.5B2026.06 | 20.72 | — | — | 14.14 | |
| Whisper (Fine-tuned)Params=1.5B2026.06 | 21.67 | — | — | 13.25 | |
| WhisperATC (Large)Params=1.5B2026.06 | 22.5 | — | — | 12.17 | |
| Ours (pipeline)2026.03 | 23.9 | 40.5 | 24.5 | — | |
| Ours (pipeline)filtering=VCM2026.03 | 24.4 | 47.2 | 25 | — | |
| Ours (pipeline)filtering=Random2026.03 | 26.2 | 47.8 | 26.8 | — | |
| Ours (pipeline)filtering=PPLmin2026.03 | 26.6 | 45.7 | 27.3 | — | |
| DAS2026.03 | 28.8 | 82.5 | 29.4 | — | |
| Whisper-large-v3-turbo2026.03 | 28.9 | 84 | 29.5 | — | |
| MERaLiON 2Params=10B2026.06 | 48.63 | — | — | 19.56 | |
| ParakeetParams=0.6B2026.06 | 53.22 | — | — | 23.07 | |
| WhisperATC (Small)Params=0.2B2026.06 | 54.33 | — | — | 19.79 | |
| Whisper (Large)Params=1.5B2026.06 | 80.49 | — | — | 53.81 | |
| Whisper (Small)Params=0.2B2026.06 | 91.05 | — | — | 61.51 |