Audio Reasoning on MMAU v05.15.25 (mini)
61.86Sound ScoreSAM+OR-2.7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SAM+OR-2.7BSize=2.7B, Supervision=OpenReasonAQA2025.09 | 61.86 | 48.8 | 31.23 | |
| SAM+OR-780MSize=780M, Supervision=OpenReasonAQA2025.09 | 58.86 | 43.71 | 30.33 | |
| Gemma 3n-4BSize=4B2025.09 | 55.86 | 56.89 | 61.26 | |
| Gemma 3n-2BSize=2B2025.09 | 51.35 | 52.1 | 52.22 | |
| SAM+OR-130MSize=130M, Supervision=OpenReasonAQA2025.09 | 48.95 | 40.12 | 20.72 | |
| GAMA-7BSize=7B2025.09 | 31.83 | 17.71 | 12.91 | |
| SAM-2.7BSize=2.7B2025.09 | 24.92 | 16.47 | 3.3 | |
| LTU-7BSize=7B2025.09 | 22.52 | 9.69 | 17.71 | |
| SAM-130MSize=130M2025.09 | 11.41 | 5.99 | 5.11 | |
| SAM-780MSize=780M2025.09 | 9.01 | 7.49 | 2.7 |