Audio Understanding & Reasoning on Alpaca Audio
64.24GPT ScoreQwen2.5-Omni-7B + CoAT
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-Omni-7B + CoATBackbone=Qwen2.5-Omni-7B, Method=CoAT2026.06 | 64.24 | |
| Qwen2.5-Omni-7BBackbone=Qwen2.5-Omni-7B, Method=Baseline2026.06 | 60.6 | |
| Audio Flamingo 3 + CoATBackbone=Audio Flamingo 3, Method=CoAT2026.06 | 58.59 | |
| Qwen2-AudioBackbone=Qwen2-Audio, Method=Baseline2026.06 | 57.4 | |
| Qwen2-Audio + CoATBackbone=Qwen2-Audio, Method=CoAT2026.06 | 56.97 | |
| Audio Flamingo 3Backbone=Audio Flamingo 3, Method=Baseline2026.06 | 38.8 |