Multi-speaker ASR on LibriSpeech2Mix
4WERWhisper-medium-SS-TTI [47]
Evaluation results
| Method | Links | |
|---|---|---|
| Whisper-medium-SS-TTI [47]Training Set=LibriSpeechMix, Training hours=960 hours, Mix Type=speech only, Overlap Mode=partial2025.08 | 4 | |
| SOT-Conformer [46]Training Set=LibriSpeechMix, Training hours=960 hours, Mix Type=speech only, Overlap Mode=partial2025.08 | 4.9 | |
| UME ASR init. (0.33, 0.33, 0.34) w/ RWSE (A4)Training Set=LibriMix, Training hours=460 hours, Mix Type=mixclean: speech only, Overlap Mode=max, Initialization=ASR init., Training weights (λasr, λdiar, λsep)=(0.33, 0.33, 0.34), RWSE=true2025.08 | 5.5 | |
| t-SOT [21]Training Set=LibriSpeechMix, Training hours=960 hours, Mix Type=speech only, Overlap Mode=partial2025.08 | 5.8 | |
| SURT [45]Training Set=LibriSpeechMix, Training hours=960 hours, Mix Type=speech only, Overlap Mode=partial2025.08 | 7.2 | |
| UME (0.33, 0.33, 0.34) + ASR init.Training Set=LibriMix, Training hours=460 hours, Mix Type=mixboth: speech + noise, Overlap Mode=max, Initialization=ASR init., Training weights (λasr, λdiar, λsep)=(0.33, 0.33, 0.34)2025.08 | 9.2 | |
| UME ASR init. (0.33, 0.33, 0.34) w/ RWSE (A3)Training Set=LibriMix, Training hours=460 hours, Mix Type=mixboth: speech + noise, Overlap Mode=max, Initialization=ASR init., Training weights (λasr, λdiar, λsep)=(0.33, 0.33, 0.34), RWSE=true2025.08 | 10.3 | |
| UME (0.33, 0.33, 0.34)Training Set=LibriMix, Training hours=460 hours, Mix Type=mixboth: speech + noise, Overlap Mode=max, Training weights (λasr, λdiar, λsep)=(0.33, 0.33, 0.34)2025.08 | 11 | |
| SOT [10]Training Set=LibriSpeechMix, Training hours=960 hours, Mix Type=speech only, Overlap Mode=partial2025.08 | 11.2 | |
| PIT LSTM-AED [10]Training Set=LibriSpeechMix, Training hours=960 hours, Mix Type=speech only, Overlap Mode=partial2025.08 | 11.9 | |
| UME (0.1, 0.1, 0.8)Training Set=LibriMix, Training hours=460 hours, Mix Type=mixboth: speech + noise, Overlap Mode=max, Training weights (λasr, λdiar, λsep)=(0.1, 0.1, 0.8)2025.08 | 11.9 | |
| Multi-speaker AED [9] (reproduced)Training Set=LibriMix, Training hours=460 hours, Mix Type=mixboth: speech + noise, Overlap Mode=max2025.08 | 12.7 | |
| UME (0.1, 0.1, 0.8) w/ weighted sumTraining Set=LibriMix, Training hours=460 hours, Mix Type=mixboth: speech + noise, Overlap Mode=max, Training weights (λasr, λdiar, λsep)=(0.1, 0.1, 0.8), Weighted Sum=true2025.08 | 12.8 | |
| UME (λasr = 1.0)Training Set=LibriMix, Training hours=460 hours, Mix Type=mixboth: speech + noise, Overlap Mode=max, Training weights (λasr, λdiar, λsep)=(1.0, 0, 0)2025.08 | 13 |