Audio Question Answering on Multi-sound-object soundscapes
72.1AccuracyQwen2.5-Omni
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-Omnisetting=GRPO with external audio data2026.01 | 72.1 | 75.1 | |
| Speech-Handsmode=parallel agentic, sampling=majority sampling2026.01 | 59.4 | 77.37 | |
| Speech-Handsmode=parallel agentic, setting=SFT with official training data2026.01 | 58.29 | 75.75 | |
| AudioFlamingo 3 (AF3)2026.01 | 57.31 | 74.49 | |
| Qwen2.5-Omni2026.01 | 56.32 | 57.87 | |
| Qwen2.5-Omnisetting=GER: => AF3 (cascaded agentic)2026.01 | 52.02 | 68.93 | |
| Gemini-2-Flash2026.01 | 46.34 | 56.61 | |
| Qwen2.5-Omnisetting=GRPO with official training data2026.01 | 39.43 | 65.54 | |
| Qwen2.5-Omnisetting=SFT with official training data2026.01 | 34.65 | 63.13 |