Speech Semantic Understanding on sBLIMP
59sBLIMP ScoreTWIST-7B
Evaluation results
| Method | Links | |
|---|---|---|
| TWIST-7BScale=7B2026.02 | 59 | |
| SpiritLM-base-7BScale=7B2026.02 | 58.3 | |
| Llama-Mimi-8BScale=8B2026.02 | 55.1 | |
| Llama-Mimi-1.3BScale=1.3B2026.02 | 54.3 | |
| SpiritLM-Expr-7BScale=7B2026.02 | 54.2 | |
| SODA-base-4BScale=4B2026.02 | 52.4 | |
| SODA-base-1.7BScale=1.7B2026.02 | 51.4 | |
| SODA-base-600MScale=600M2026.02 | 51.2 | |
| SODA-prelim-600MScale=600M, Stage=prelim2026.02 | 50.9 | |
| SODA-base-135MScale=135M2026.02 | 50.1 |