Transcript Alignment on PriMock57 (PM57) 1 (test)
84.6Character GLEerror-align
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| error-alignBackbone Model=Whisper (v3, 1.6B), Beam size=1002025.09 | 84.6 | 83.3 | |
| PWRBackbone Model=Whisper (v3, 1.6B)2025.09 | 81.7 | 81.4 | |
| error-alignBackbone Model=Parakeet CTC (0.6B), Beam size=1002025.09 | 79.9 | 78.2 | |
| error-alignBackbone Model=Parakeet TDT (v2, 0.6B), Beam size=1002025.09 | 79.4 | 77.8 | |
| error-alignBackbone Model=Phi-4-multimodal (5.6B), Beam size=1002025.09 | 77.9 | 75.8 | |
| PWRBackbone Model=Parakeet TDT (v2, 0.6B)2025.09 | 77.2 | 76.2 | |
| PWRBackbone Model=Parakeet CTC (0.6B)2025.09 | 77 | 76 | |
| OWABackbone Model=Whisper (v3, 1.6B)2025.09 | 76.7 | 75.9 | |
| PWRBackbone Model=Phi-4-multimodal (5.6B)2025.09 | 75.9 | 74.2 | |
| LWABackbone Model=Whisper (v3, 1.6B)2025.09 | 72.5 | 72 | |
| OWABackbone Model=Parakeet TDT (v2, 0.6B)2025.09 | 71.7 | 70.3 | |
| OWABackbone Model=Parakeet CTC (0.6B)2025.09 | 71.3 | 69.9 | |
| OWABackbone Model=Phi-4-multimodal (5.6B)2025.09 | 70.8 | 68.8 | |
| LWABackbone Model=Parakeet TDT (v2, 0.6B)2025.09 | 67.3 | 66 | |
| LWABackbone Model=Phi-4-multimodal (5.6B)2025.09 | 66.7 | 64.7 | |
| LWABackbone Model=Parakeet CTC (0.6B)2025.09 | 66.7 | 65.5 |