Spoken Understanding and Reasoning on URO-Bench Chinese Basic
91.1U ScoreStep-Audio 2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Step-Audio 22026.05 | 91.1 | 75.5 | 86.1 | 83.3 | |
| GPT-4o-Audio2026.05 | 89.4 | 65.5 | 85.2 | 78.6 | |
| GPT-Realtime2026.05 | 88.8 | 72.9 | 90.8 | 80.6 | |
| Kimi-Audio2026.05 | 79.3 | 64.7 | 79.8 | 73.6 | |
| Listen-Write-Speak2026.05 | 79.3 | 72.4 | 96.1 | 82.6 | |
| Listen-Write-Speak (w/o write while speak)visible writing during speaking=disabled2026.05 | 73.4 | 75.9 | 71.9 | 73.7 | |
| Listen-Write-Speak (w/o write while listen)visible writing during listening=disabled2026.05 | 65.9 | 72.5 | 95.3 | 77.9 | |
| Qwen-Omni2026.05 | 59.7 | 69.7 | 77.3 | 69 |