Speech Semantic Understanding on sWUGGY
73.9sWUGGY AccuracyTWIST-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| TWIST-7BScale=7B2026.02 | 73.9 | |
| SpiritLM-base-7BScale=7B2026.02 | 69 | |
| Llama-Mimi-8BScale=8B2026.02 | 68.8 | |
| Llama-Mimi-1.3BScale=1.3B2026.02 | 68.7 | |
| SpiritLM-Expr-7BScale=7B2026.02 | 65 | |
| SODA-base-4BScale=4B2026.02 | 61.8 | |
| SODA-base-1.7BScale=1.7B2026.02 | 60.6 | |
| SODA-base-600MScale=600M2026.02 | 58.9 | |
| SODA-prelim-600MScale=600M2026.02 | 57.8 | |
| SODA-base-135MScale=135M2026.02 | 56.3 |