Text-Audio Reasoning on MMAR & MMAU L4 Difficult 1.0
54Pass@1 AccuracyQwen3-Omni
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-OmniModel Category=Omni models2025.12 | 54 | 0 | |
| Omni-AutoThinkModel Category=Omni models2025.12 | 49 | 0.69 | |
| Qwen-AudioModel Category=Expert models2025.12 | 30 | 0 | |
| Qwen2.5-OmniModel Category=Omni models2025.12 | 22 | 0 |