Automatic Speech Recognition on SEAME Man (dev)
10.1MERWhisper-Largev3
Evaluation Results
| Method | Links | |
|---|---|---|
| Whisper-Largev3Real Duration (h)=100, TTS-R Duration (h)=1002026.01 | 10.1 | |
| Whisper-large-v3 + ft full model#Train. Params.=1541.6 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 10.3 | |
| Whisper-Largev3Real Duration (h)=100, TTS-O Duration (h)=1002026.01 | 11.1 | |
| Whisper-medium + ft full model#Train. Params.=762.3 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 11.5 | |
| Whisper-Largev3Real Duration (h)=1002026.01 | 12.1 | |
| Whisper-Largev3TTS-R Duration (h)=2002026.01 | 12.2 | |
| Whisper-Largev3TTS-O Duration (h)=1002026.01 | 12.5 | |
| Subsequent Iterative, M2Iteration=22026.07 | 12.88 | |
| Whisper-small + ft full model + w/ SPT*#Train. Params.=240.7 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 13.1 | |
| Whisper-small + ft full model#Train. Params.=240.6 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 13.2 | |
| Whisper-small + ft full model + w/ FA-LID-UB#Train. Params.=240.6 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 13.2 | |
| Whisper-small + ft full model + w/ FA-LID-LB#Train. Params.=240.6 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 13.3 | |
| Whisper-small + ft full model + w/ LAL#Train. Params.=240.6 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 13.3 | |
| First Iterative, M1Iteration=12026.07 | 13.39 | |
| Whisper-small + adapt. w/ LoRA#Train. Params.=4.4 M, pre-training (pt)=true, Tuning=adaptation tuning2025.09 | 13.5 | |
| Whisper-small + ft full model + w/ CTC-LID#Train. Params.=240.6 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 13.7 | |
| Whisper-small + adapt. w/ Bi-LoRA#Train. Params.=4.4 M, pre-training (pt)=true, Tuning=adaptation tuning2025.09 | 13.8 | |
| Whisper-small + ft encoder-only#Train. Params.=87.0 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 14.6 | |
| Conformer + WavLM-large#Train. Params.=48.3 M, pre-training (pt)=true2025.09 | 15.2 | |
| Conformer + XLS-R-0.3B#Train. Params.=48.3 M, pre-training (pt)=true2025.09 | 15.3 | |
| Conformer + LLM GER#Train. Params.=48.3 M, pre-training (pt)=false2025.09 | 15.7 | |
| E-Branchformer + CAMEL#Train. Params.=55.3 M, pre-training (pt)=false2025.09 | 16.1 | |
| Conformer + LPB#Train. Params.=79.9 M, pre-training (pt)=false2025.09 | 16.3 | |
| Conformer + ILB#Train. Params.=79.9 M, pre-training (pt)=false2025.09 | 16.4 | |
| Conformer + LAL#Train. Params.=48.3 M, pre-training (pt)=false2025.09 | 16.4 | |
| Branchformer#Train. Params.=39.0 M, pre-training (pt)=false2025.09 | 16.4 | |
| E-Branchformer#Train. Params.=39.9 M, pre-training (pt)=false2025.09 | 16.4 | |
| Conformer#Train. Params.=48.3 M, pre-training (pt)=false2025.09 | 16.6 | |
| ConExtBiMamba*#Train. Params.=54.6 M, pre-training (pt)=false2025.09 | 16.6 | |
| Whisper-small + ft decoder-only#Train. Params.=153.6 M, pre-training (pt)=true, Tuning=full-parameter fine-tuning2025.09 | 17.4 | |
| Whisper-Largev3TTS-R Duration (h)=1002026.01 | 17.7 | |
| Transformer#Train. Params.=29.8 M, pre-training (pt)=false2025.09 | 17.7 | |
| Baseline2026.07 | 19.23 | |
| Initial bilingual, M0Iteration=02026.07 | 61.09 | |
| Whisper-large-v3pre-training (pt)=true2025.09 | 73.5 | |
| Private model2026.07 | 85.31 | |
| Whisper-mediumpre-training (pt)=true2025.09 | 87.1 | |
| Whisper-smallpre-training (pt)=true2025.09 | 90.8 |