Audio Question Answering on MMAU mini
73.1Overall ScoreAudio Flamingo 3
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Audio Flamingo 32026.06 | 73.1 | 76.9 | 66.1 | 73.9 | |
| Gemini 2.5 Pro2026.06 | 71.6 | 75.1 | 71.5 | 68.3 | |
| Qwen2.5-Omni2026.06 | 71.5 | 65.9 | 78.1 | 70.6 | |
| ALM2Vecstage=Pre-trained2026.06 | 66.3 | 62.3 | 78.7 | 58 | |
| ALM2Vecstage=Fine-tuned2026.06 | 63 | 61.7 | 74.8 | 52.6 | |
| GPT-4o Audio2026.06 | 60.8 | 63.2 | 64.6 | 56.3 |