Intent Classification on Intent Classification (IC)
89.6AccuracyWhisper + Llama 2 + MMS TTS
Evaluation results
| Method | Links | |
|---|---|---|
| Whisper + Llama 2 + MMS TTSShots=30, Approach=Cascade Topline2024.02 | 89.6 | |
| SPIRIT LM BASE (+ASR+TTS)Shots=302024.02 | 75.8 | |
| SPIRIT LM BASEShots=302024.02 | 71.9 | |
| SPIRIT LM EXPRESSIVEShots=302024.02 | 66.2 | |
| Word-level transcriptionShots=30, Training=Parallel Data2024.02 | 22.6 | |
| ASR+TTS onlyShots=30, Training=Parallel Data2024.02 | 7.4 |