Spoken Question Answering on UltraEval-Audio TriviaQA
76.07S2T ScoreGPT-4o
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o2026.06 | 76.07 | — | |
| Qwen3-Omni-30B2026.06 | 61.43 | 57.52 | |
| Qwen2.5-Omni-7B2026.06 | 47.66 | 45.6 | |
| Backbone-LLM-7B2026.06 | 47.07 | — | |
| PRIME-Speech-9B2026.06 | 46.98 | 44.54 | |
| Kimi-Audio-7B2026.06 | 46.78 | 37.99 | |
| VocalNet-8Bstreaming mode=true2026.06 | 44.63 | 38.38 | |
| GLM-4-Voice-9B2026.06 | 39.1 | 26.5 | |
| Step-Audio-2-Mini-7B2026.06 | 33.4 | 32.23 |