Spoken Understanding and Reasoning on URO-Bench Chinese (Pro)
93.9U ScoreListen-Write-Speak (w/o write while speak)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Listen-Write-Speak (w/o write while speak)visible writing during speaking=disabled2026.05 | 93.9 | 84.4 | 63.6 | 80.6 | |
| Listen-Write-Speak2026.05 | 92.5 | 85.9 | 75.5 | 84.6 | |
| Listen-Write-Speak (w/o write while listen)visible writing during listening=disabled2026.05 | 86 | 84.4 | 74.6 | 81.7 | |
| Step-Audio 22026.05 | 74.8 | 63.2 | 65.1 | 68.3 | |
| GPT-Realtime2026.05 | 72.3 | 62.6 | 74.2 | 70.6 | |
| GPT-4o-Audio2026.05 | 70.6 | 57.2 | 70.2 | 67.1 | |
| Kimi-Audio2026.05 | 60.4 | 59.3 | 76.2 | 66 | |
| Qwen-Omni2026.05 | 59 | 59.8 | 58.7 | 59.1 |