Intent Recognition on VoiceStick Explicit Subset
96AccuracyCamemBERT (Large)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CamemBERT (Large)Input=Manual Text (Oracle)2026.06 | 96 | 22 | |
| XLSR-53-FR (Large)Input=Raw Audio (Proposed End-to-End), Distillation=Yes2026.06 | 93 | 7 | |
| Average⋆Input=Manual Text (Oracle)2026.06 | 92 | 16 | |
| WavLM (Large)Input=Raw Audio (Proposed End-to-End), Distillation=Yes2026.06 | 92 | 14 | |
| Average⋆Input=Raw Audio (Proposed End-to-End), Distillation=Yes2026.06 | 87 | 11 | |
| WavLM (Large)Input=Raw Audio, Distillation=No2026.06 | 87 | 14 | |
| XLSR-53-FR (Large)Input=Raw Audio, Distillation=No2026.06 | 82 | 7 | |
| Average⋆Input=Raw Audio, Distillation=No2026.06 | 80 | 11 | |
| CamemBERT (Large)Input=Audio → Whisper → Text (Cascade)2026.06 | 79 | 202 | |
| Average⋆Input=Audio → Whisper → Text (Cascade)2026.06 | 76 | 196 | |
| XLSR-53 (Large)†Input=Raw Audio (Proposed End-to-End), Distillation=Yes2026.06 | 68 | 10 |