Speech Conversation on URO-Bench English Basic
94.2Understanding Score (U)MPS-thkfirst
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MPS-thkfirstStrategy=Think-First, Language=English2025.10 | 94.2 | 81.4 | 89 | 87 | |
| MPS-spkfirstStrategy=Speak-First, Language=English2025.10 | 94.1 | 78.5 | 87.5 | 85.2 | |
| Step-Audio 2Language=English2025.10 | 92.7 | 76.5 | 84.9 | 83.9 | |
| MPS-tbsStrategy=Think-Before-Speaking, Language=English2025.10 | 92.3 | 81.5 | 87.5 | 86.1 | |
| MPS-wo/thkStrategy=without a thinking process, Language=English2025.10 | 91.5 | 68.7 | 78.8 | 77.4 | |
| GPT-4o AudioLanguage=English2025.10 | 90.2 | 75.9 | 90.4 | 84.5 | |
| GPT-RealtimeLanguage=English2025.10 | 87.4 | 84.1 | 94.1 | 88.1 | |
| Kimi-AudioLanguage=English2025.10 | 83.4 | 42.3 | 60.4 | 60 | |
| Qwen-OmniLanguage=English2025.10 | 66.3 | 69.6 | 76.2 | 70.6 |