Speech Understanding on BigBench Audio
83.7S2T ScoreQwen3-Omni-30B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-Omni-30B2026.06 | 83.7 | 72 | |
| GPT-4o2026.06 | 70.2 | 67.2 | |
| Backbone-LLM-7B2026.06 | 66.5 | — | |
| PRIME-Speech-9B2026.06 | 66.2 | 63.4 | |
| Kimi-Audio-7B2026.06 | 59.4 | 51 | |
| Qwen2.5-Omni-7B2026.06 | 54.2 | 53.6 | |
| Step-Audio-2-Mini-7B2026.06 | 50.9 | 47.5 | |
| VocalNet-8Bstreaming mode=true2026.06 | 45.9 | 44.9 | |
| GLM-4-Voice-9B2026.06 | 44.8 | 42.7 |