Speaker-Attributed Automatic Speech Recognition on AISHELL-4 (test)
0.2004cpCERMOSS Transcribe Diarize
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MOSS Transcribe Diarize2026.01 | 0.2004 | 0.1543 | 0.0461 | — | — | — | |
| DoubaoModel=Speech Recognition Model2026.01 | 0.2786 | 0.1818 | 0.0968 | — | — | — | |
| ElevenLabsModel=Scribe v12026.01 | 0.3795 | 0.1958 | 0.1836 | — | — | — | |
| Gemini 2.5 Pro2026.01 | 0.5342 | 0.427 | 0.1072 | — | — | — | |
| Speaker-Reasoner Multi-turn w/ SACStage=32026.04 | 14.73 | 13.83 | 0.9 | 5.26 | — | — | |
| Speaker-Reasoner Multi-turnStage=22026.04 | 14.93 | 13.83 | 1.1 | 5.19 | — | — | |
| Speaker-Reasoner BaseStage=12026.04 | 16.54 | 14.04 | 2.5 | 6.24 | — | — | |
| DM-ASR (S2SND) (CN+EN 2900h)Parms=1.7B, Training Data / Hours=CN+EN 2900h, Diarization Source=S2SND, Time Prediction Source=LLM-predicted, Label Perturbation Status=None2026.04 | 17.66 | — | — | 10.56 | 4.16 | 18.1 | |
| SpeakerLMArchitecture=End-to-End Baselines, Training Data=7638.95h2026.04 | 18.37 | 17.17 | 1.2 | — | — | — | |
| SpeakerLM (7639h)Parms=7B, Training Data / Hours=7639h2026.04 | 18.37 | — | — | — | — | — | |
| DM-ASR (DiariZen) (CN+EN 2900h)Parms=0.6B, Training Data / Hours=CN+EN 2900h, Diarization Source=DiariZen, Time Prediction Source=LLM-predicted, Label Perturbation Status=None2026.04 | 18.96 | — | — | 12.01 | — | 19.67 | |
| DM-ASR (DiariZen) (CN+EN 2900h)Parms=1.7B, Training Data / Hours=CN+EN 2900h, Diarization Source=DiariZen, Time Prediction Source=LLM-predicted, Label Perturbation Status=None2026.04 | 19.01 | — | — | 12.01 | — | 19.73 | |
| DM-ASR (S2SND) (CN 1300h)Parms=1.7B, Training Data / Hours=CN 1300h, Diarization Source=S2SND, Time Prediction Source=LLM-predicted, Label Perturbation Status=None2026.04 | 19.21 | — | — | 10.56 | — | 19.94 | |
| Qwen3-Omni + SOT sftArchitecture=End-to-End, Stage=Ablation baseline2026.04 | 19.59 | 17.65 | 1.94 | — | — | — | |
| DM-ASR (DiariZen) (CN 1300h)Parms=0.6B, Training Data / Hours=CN 1300h, Diarization Source=DiariZen, Time Prediction Source=LLM-predicted, Label Perturbation Status=None2026.04 | 19.69 | — | — | 12 | — | 20.4 | |
| DM-ASR (DiariZen) (CN 1300h)Parms=1.7B, Training Data / Hours=CN 1300h, Diarization Source=DiariZen, Time Prediction Source=LLM-predicted, Label Perturbation Status=None2026.04 | 19.85 | — | — | 12.01 | — | 20.79 | |
| MOSS Transcribe DiarizeParms=-2026.04 | 20.04 | — | — | — | — | — | |
| DM-ASR (DiariZen) (CN 630h)Parms=0.6B, Training Data / Hours=CN 630h, Diarization Source=DiariZen, Time Prediction Source=LLM-predicted, Label Perturbation Status=None2026.04 | 21.58 | — | — | 12.01 | — | 23.04 | |
| Qwen3-Omni-30B-A3B-InstructArchitecture=End-to-End Baselines2026.04 | 22.22 | 14.46 | 7.76 | 32.42 | — | — | |
| Speaker-Reasoner Multi-turn 7BScale=7B2026.04 | 22.91 | 15.31 | 7.6 | 9.38 | — | — | |
| SpeakerLM (2270h)Parms=7B, Training Data / Hours=2270h2026.04 | 23.1 | — | — | — | — | — | |
| VibeVoice-ASR(>9400h)Parms=7B, Training Data / Hours=>9400h2026.04 | 24.99 | — | — | 6.77 | — | 25.35 | |
| Gemini-2.5-ProArchitecture=End-to-End Baselines, Access=Closed-source model2026.04 | 25.11 | 19.81 | 5.3 | 36.07 | — | — | |
| SpeakerLM (694h)Parms=7B, Training Data / Hours=694h2026.04 | 25.28 | — | — | — | — | — | |
| Speaker-Reasoner Base 7BScale=7B2026.04 | 25.6 | 15.65 | 9.95 | 12 | — | — | |
| SpeakerLMArchitecture=End-to-End Baselines, Training Data=212.25h2026.04 | 26.14 | 17.75 | 8.39 | — | — | — | |
| Pyannote3.1 + ParaformerArchitecture=Cascade Baselines2026.04 | 26.24 | 19.18 | 7.06 | 8.1 | — | — | |
| VibeVoice-ASRArchitecture=End-to-End Baselines2026.04 | 26.3 | 22.3 | 4 | 10.88 | — | — | |
| Gemini-3.0-ProParms=-2026.04 | 27.43 | — | — | 22.03 | — | 54.17 | |
| Gemini-2.5-ProParms=-2026.04 | 31.59 | — | — | 15.32 | — | 35.96 | |
| DiariZen+Whisper-large-v3Parms=1.5B2026.04 | 34.42 | — | — | 11.97 | — | 37.4 | |
| TagSpeech-AlimeetingArchitecture=End-to-End Baselines2026.04 | 53.44 | 35.7 | 17.74 | 37.51 | — | — | |
| Qwen2.5-Omni-7BArchitecture=End-to-End Baselines2026.04 | 60.45 | 33.37 | 27.08 | 85.68 | — | — |