Intent Detection on SLURP
89.16AccuracyML-LMCL
Evaluation Results
| Method | Links | |
|---|---|---|
| ML-LMCLmanual transcripts=true2023.11 | 89.16 | |
| ML-LMCLmanual transcripts=false2023.11 | 88.52 | |
| SpokenCSEmanual transcripts=true2023.11 | 85.64 | |
| SpokenCSEmanual transcripts=false2023.11 | 85.26 | |
| SimCSEmanual transcripts=true2023.11 | 84.88 | |
| SimCSEmanual transcripts=false2023.11 | 84.47 | |
| RoBERTamanual transcripts=true2023.11 | 84.42 | |
| Phoneme-BERTmanual transcripts=true2023.11 | 84.16 | |
| RoBERTamanual transcripts=false2023.11 | 83.97 | |
| Phoneme-BERTmanual transcripts=false2023.11 | 83.78 | |
| STACodecBitrate (kbps)=4.0, Semantic Info.=WavLM-large2026.02 | 74.21 | |
| STACodecBitrate (kbps)=4.0, Semantic Info.=HuBERT-base2026.02 | 70.81 | |
| X-CodecBitrate (kbps)=4.0, Semantic Info.=HuBERT-base2026.02 | 66.49 | |
| STACodec-SPDBitrate (kbps)=4.0, Semantic Info.=WavLM-large2026.02 | 64.31 | |
| PASTBitrate (kbps)=4.0, Semantic Info.=ASR and PR2026.02 | 59.5 | |
| SpeechTokenizerBitrate (kbps)=4.0, Semantic Info.=HuBERT-base2026.02 | 56.61 |