Text-Audio Reasoning on MMAR & MMAU L2 Simple 1.0
91Pass@1 AccuracyQwen2.5-Omni
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-OmniModel Category=Omni models2025.12 | 91 | 0 | |
| Omni-AutoThinkModel Category=Omni models2025.12 | 91 | 37 | |
| Qwen3-OmniModel Category=Omni models2025.12 | 85 | 0 | |
| Qwen-AudioModel Category=Expert models2025.12 | 62 | 0 |