Multi-speaker Automatic Speech Recognition on AMI IHM (test)
16.4cpWERDM-ASR (S2SND) (CN+EN 2900h)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DM-ASR (S2SND) (CN+EN 2900h)Parms=1.7B, Label perturbation=None, Diarization source=diarization-provided speakers, Time prediction=LLM-predicted times2026.04 | 16.4 | 11.48 | 16.93 | 4.89 | |
| DM-ASR (DiariZen) (CN+EN 2900h)Parms=1.7B, Label perturbation=None, Diarization source=diarization-provided speakers, Time prediction=LLM-predicted times2026.04 | 17.16 | 27.87 | 18.09 | — | |
| DM-ASR (DiariZen) (EN 1600h)Parms=0.6B, Label perturbation=None, Diarization source=diarization-provided speakers, Time prediction=LLM-predicted times2026.04 | 17.34 | 27.87 | 18.28 | — | |
| DM-ASR (DiariZen) (CN+EN 2900h)Parms=0.6B, Label perturbation=None, Diarization source=diarization-provided speakers, Time prediction=LLM-predicted times2026.04 | 17.47 | 27.87 | 18.41 | — | |
| DM-ASR (DiariZen) (EN 630h)Parms=0.6B, Label perturbation=None, Diarization source=diarization-provided speakers, Time prediction=LLM-predicted times2026.04 | 18.45 | 27.87 | 19.52 | — | |
| VibeVoice-ASRParms=7B2026.04 | 20.41 | 11.92 | 20.82 | — | |
| Gemini-3.0-ProParms=-2026.04 | 22.34 | 46.23 | 63.65 | — | |
| JEDIS-LLM(10000h)Parms=5.6B2026.04 | 23.13 | — | — | — | |
| Gemini-2.5-ProParms=-2026.04 | 29.57 | 23.54 | 38.35 | — | |
| DiariZen + Whisper-large-v3Parms=1.5B2026.04 | 32.27 | 27.67 | 33.99 | — | |
| Tagspeech(65h)Parms=7B2026.04 | 33.84 | 22.13 | — | — | |
| Qwen2.5-Omni-7BParms=7B2026.04 | 41.23 | 37.42 | — | — |