Text-Audio Reasoning on MMAR & MMAU L3 Intermediate 1.0
65Pass@1 AccuracyQwen2.5-Omni
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-OmniModel Category=Omni models2025.12 | 65 | 0 | |
| Omni-AutoThinkModel Category=Omni models2025.12 | 65 | 0.6 | |
| Qwen3-OmniModel Category=Omni models2025.12 | 60 | 0 | |
| Qwen-AudioModel Category=Expert models2025.12 | 36 | 0 |