Audio Reasoning on MMAU v05.15.25 (base)
59.73Sound AccuracySAM+OR-780M
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAM+OR-780MSize=780M, Supervision=OpenReasonAQA2025.09 | 59.73 | 46.63 | 33 | |
| SAM+OR-2.7BSize=2.7B, Supervision=OpenReasonAQA2025.09 | 56.77 | 50.43 | 27.43 | |
| Gemma 3n-4BSize=4B2025.09 | 50.27 | 53.2 | 62.13 | |
| Gemma 3n-2BSize=2B2025.09 | 47.47 | 51.63 | 57.07 | |
| SAM+OR-130MSize=130M, Supervision=OpenReasonAQA2025.09 | 46.93 | 41.47 | 23.93 | |
| GAMA-7BSize=7B2025.09 | 30.73 | 17.33 | 16.97 | |
| LTU-7BSize=7B2025.09 | 25.86 | 12.83 | 16.37 | |
| SAM-2.7BSize=2.7B2025.09 | 22.83 | 15.87 | 4.7 | |
| SAM-130MSize=130M2025.09 | 11.67 | 7.67 | 4.77 | |
| SAM-780MSize=780M2025.09 | 7.8 | 6.13 | 2.1 |