Speech Conversation on URO-Bench English Pro
76.5Understanding ScoreMPS-thkfirst
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MPS-thkfirstStrategy=Think-First, Language=English2025.10 | 76.5 | 89.3 | 89.4 | 85 | |
| MPS-tbsStrategy=Think-Before-Speaking, Language=English2025.10 | 76.4 | 86.4 | 87.1 | 83.3 | |
| MPS-spkfirstStrategy=Speak-First, Language=English2025.10 | 76 | 89.7 | 69.9 | 74.8 | |
| MPS-wo/thkStrategy=without a thinking process, Language=English2025.10 | 73.4 | 79.2 | 55.8 | 65.1 | |
| Step-Audio 2Language=English2025.10 | 64.9 | 67.8 | 66.3 | 66.1 | |
| GPT-4o AudioLanguage=English2025.10 | 60.7 | 64.4 | 78.5 | 67.5 | |
| GPT-RealtimeLanguage=English2025.10 | 59.7 | 74.5 | 76.1 | 68.9 | |
| Kimi-AudioLanguage=English2025.10 | 50.3 | 40.6 | 56 | 49.8 | |
| Qwen-OmniLanguage=English2025.10 | 44.5 | 63.9 | 49.4 | 51 |