Word alignment on TIMIT (test)
92.3Alignment Accuracy (t ≤ 50)MFA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MFAModel Type=GM-HMM, Align method=Likelihood2026.07 | 92.3 | — | — | — | 19 | |
| MWA2026.06 | 91.6 | 58 | 81.3 | 97.8 | — | |
| MFA2026.06 | 89.4 | 41.6 | 72.8 | 97.4 | — | |
| WhisperX2026.06 | 82.4 | 22.4 | 52.7 | 94.2 | — | |
| XLS-R (Phoneme)Model Type=CTC, Align method=Posteriors2026.07 | 80.7 | — | — | — | 30 | |
| CrisperWhisperModel Type=AED, Align method=Cross-att.2026.07 | 80.7 | — | — | — | 33 | |
| Whisper-large-v3Model Type=AED, Align method=Gradients*, Note=optimal encoder depth 3/42026.07 | 76.9 | — | — | — | 33 | |
| OWLS-1BModel Type=AED, Align method=Cross-att.2026.07 | 76.7 | — | — | — | 35 | |
| MMS2026.06 | 75.7 | 18.6 | 43.5 | 94.7 | — | |
| MMS-FAModel Type=CTC, Align method=Posteriors2026.07 | 71.5 | — | — | — | 37 | |
| Whisper-large-v3Model Type=AED, Align method=Cross-att.2026.07 | 66.7 | — | — | — | 42 | |
| XLS-R (Phoneme)Model Type=CTC, Align method=Gradients2026.07 | 65.7 | — | — | — | 49 | |
| MMS-FAModel Type=CTC, Align method=Gradients2026.07 | 64.3 | — | — | — | 49 | |
| Whisper-baseModel Type=AED, Align method=Cross-att.2026.07 | 62.3 | — | — | — | 51 | |
| VoxtralModel Type=Speech LLM, Align method=Self-att.2026.07 | 61.1 | — | — | — | 53 | |
| Whisper-baseModel Type=AED, Align method=Gradients2026.07 | 59.3 | — | — | — | 51 | |
| Whisper-large-v3Model Type=AED, Align method=Gradients2026.07 | 57.8 | — | — | — | 55 | |
| CrisperWhisperModel Type=AED, Align method=Gradients2026.07 | 54.3 | — | — | — | 60 | |
| Phi-4-MMModel Type=Speech LLM, Align method=Self-att.2026.07 | 46.6 | — | — | — | 68 | |
| VoxtralModel Type=Speech LLM, Align method=Gradients2026.07 | 45.6 | — | — | — | 77 | |
| Nvidia-Canary-1B2026.06 | 44.23 | 9.23 | 23.11 | 72.81 | — | |
| Phi-4-MMModel Type=Speech LLM, Align method=Gradients2026.07 | 43 | — | — | — | 84 | |
| Parakeet TDTModel Type=Transd., Align method=Posteriors2026.07 | 41.2 | — | — | — | 80 | |
| Parakeet CTCModel Type=CTC, Align method=Gradients2026.07 | 40.8 | — | — | — | 94 | |
| Canary-QwenModel Type=Speech LLM, Align method=Gradients2026.07 | 40.6 | — | — | — | 90 | |
| Parakeet CTCModel Type=CTC, Align method=Posteriors2026.07 | 39.4 | — | — | — | 77 | |
| Parakeet RNN-TModel Type=Transd., Align method=Posteriors2026.07 | 39.3 | — | — | — | 79 | |
| Parakeet TDTModel Type=Transd., Align method=Gradients2026.07 | 32.9 | — | — | — | 128 | |
| FastConformer (streaming)Model Type=CTC, Align method=Gradients2026.07 | 32 | — | — | — | 127 | |
| OWLS-1BModel Type=AED, Align method=Gradients2026.07 | 31.7 | — | — | — | 153 | |
| Parakeet RNN-TModel Type=Transd., Align method=Gradients2026.07 | 31.5 | — | — | — | 125 | |
| OWSM-CTCModel Type=CTC, Align method=Gradients2026.07 | 28.4 | — | — | — | 142 | |
| Canary-QwenModel Type=Speech LLM, Align method=Self-att.2026.07 | 28 | — | — | — | 131 | |
| FastConformer (streaming)Model Type=Transd., Align method=Gradients2026.07 | 27.3 | — | — | — | 153 | |
| Emformer (streaming)Model Type=Transd., Align method=Gradients2026.07 | 24.8 | — | — | — | 159 | |
| OWSM-CTCModel Type=CTC, Align method=Posteriors2026.07 | 20.6 | — | — | — | 120 | |
| FastConformer (streaming)Model Type=Transd., Align method=Posteriors2026.07 | 3.6 | — | — | — | 307 | |
| FastConformer (streaming)Model Type=CTC, Align method=Posteriors2026.07 | 1.1 | — | — | — | 357 | |
| Emformer (streaming)Model Type=Transd., Align method=Posteriors2026.07 | 0.3 | — | — | — | 394 |