Spoken Instruction Following on Phone Noisy Audio (test)
65.4LC Win RateVIRBA
Evaluation results
| Method | Links | |
|---|---|---|
| VIRBABackbone=Qwen2.5-Omni2025.08 | 65.4 | |
| VIRBABackbone=Qwen2-Audio2025.08 | 61.9 | |
| Step-Audio-R12025.08 | 58.6 | |
| Qwen2.5-Omni2025.08 | 58.2 | |
| Single-view RL2025.08 | 52.4 | |
| TTS-SFT2025.08 | 49.7 | |
| Qwen2-Audio base2025.08 | 38.2 |