Audio Question Answering on MMAU-style Complex QA
85.7AccuracySpeech-Hands
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Speech-Handsmode=parallel agentic, sampling=majority sampling2026.01 | 85.7 | 77.37 | |
| Speech-Handsmode=parallel agentic, setting=SFT with official training data2026.01 | 83.34 | 75.75 | |
| Qwen2.5-Omnisetting=GRPO with external audio data2026.01 | 82.15 | 75.1 | |
| AudioFlamingo 3 (AF3)2026.01 | 81.26 | 74.49 | |
| Qwen2.5-Omnisetting=GRPO with official training data2026.01 | 79.12 | 65.54 | |
| Qwen2.5-Omnisetting=GER: => AF3 (cascaded agentic)2026.01 | 77.48 | 68.93 | |
| Qwen2.5-Omnisetting=SFT with official training data2026.01 | 76.61 | 63.13 | |
| Gemini-2-Flash2026.01 | 59.89 | 56.61 | |
| Qwen2.5-Omni2026.01 | 59.89 | 57.87 |