Spoken Language Understanding on SLURP Oracle
91.57Intent AccuracyCORTIS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CORTISScale=7B2026.06 | 91.57 | 83.17 | 84.92 | |
| ASR–LLM CascadeScale=7B2026.06 | 91.21 | 83.86 | 86.01 | |
| CORTISScale=3B2026.06 | 90.71 | 82.3 | 84.6 | |
| ASR–LLM CascadeScale=3B2026.06 | 89.88 | 82.16 | 84.73 | |
| CORTISScale=7B2026.06 | 81.34 | 60.45 | 69.86 | |
| CORTISScale=3B2026.06 | 79.32 | 56.26 | 66.23 | |
| ASR–LLM CascadeScale=7B2026.06 | 75.75 | 56.05 | 66.98 | |
| ASR–LLM CascadeScale=3B2026.06 | 75.19 | 55.64 | 66.9 |