# Audio Reasoning on MMAU v05.15.25 (mini)

Source: [Audio Reasoning on MMAU v05.15.25 (mini)](<https://www.sota2.com/research/sota/audio-reasoning-on-mmau-v05-15-25-mini>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-06T07:18:20.675Z

Evaluation of Audio Reasoning capabilities using the specific version v05.15.25 of the MMAU mini dataset, reporting scores across Sound, Music, and Speech categories.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Audio Reasoning |
| Dataset (including any stated split) | MMAU v05.15.25 (mini) |
| Metric | Sound Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Sound Score](<https://www.sota2.com/research/sota/audio-reasoning-on-mmau-v05-15-25-mini.md?metric=Sound%20Score>): Higher is better; unit: PERCENT.

- [Music Score](<https://www.sota2.com/research/sota/audio-reasoning-on-mmau-v05-15-25-mini.md?metric=Music%20Score>): Higher is better; unit: PERCENT.

- [Speech Score](<https://www.sota2.com/research/sota/audio-reasoning-on-mmau-v05-15-25-mini.md?metric=Speech%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Sound Score | Result date | Report paper |
| --- | --- | --- | --- |
| SAM+OR-2.7B | 61.86 | Not recorded | 68fa7b721e209131cea8883d |
| SAM+OR-780M | 58.86 | Not recorded | 68fa7b721e209131cea8883d |
| Gemma 3n-4B | 55.86 | Not recorded | 68fa7b721e209131cea8883d |
| Gemma 3n-2B | 51.35 | Not recorded | 68fa7b721e209131cea8883d |
| SAM+OR-130M | 48.95 | Not recorded | 68fa7b721e209131cea8883d |
| GAMA-7B | 31.83 | Not recorded | 68fa7b721e209131cea8883d |
| SAM-2.7B | 24.92 | Not recorded | 68fa7b721e209131cea8883d |
| LTU-7B | 22.52 | Not recorded | 68fa7b721e209131cea8883d |
| SAM-130M | 11.41 | Not recorded | 68fa7b721e209131cea8883d |
| SAM-780M | 9.01 | Not recorded | 68fa7b721e209131cea8883d |

### SAM+OR-2.7B

Sound Score: 61.86. Result ID: 69aa7e206dbb7075b953c773.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"2.7B","Supervision":"OpenReasonAQA"}. This record does not assert independent reproduction.

### SAM+OR-780M

Sound Score: 58.86. Result ID: 69aa7e206dbb7075b953c774.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"780M","Supervision":"OpenReasonAQA"}. This record does not assert independent reproduction.

### Gemma 3n-4B

Sound Score: 55.86. Result ID: 69aa7e206dbb7075b953c76c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"4B"}. This record does not assert independent reproduction.

### Gemma 3n-2B

Sound Score: 51.35. Result ID: 69aa7e206dbb7075b953c76d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"2B"}. This record does not assert independent reproduction.

### SAM+OR-130M

Sound Score: 48.95. Result ID: 69aa7e206dbb7075b953c775.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"130M","Supervision":"OpenReasonAQA"}. This record does not assert independent reproduction.

### GAMA-7B

Sound Score: 31.83. Result ID: 69aa7e206dbb7075b953c76e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73a71e209131cea5db04.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### SAM-2.7B

Sound Score: 24.92. Result ID: 69aa7e206dbb7075b953c770.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"2.7B"}. This record does not assert independent reproduction.

### LTU-7B

Sound Score: 22.52. Result ID: 69aa7e206dbb7075b953c76f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72431e209131cea555aa.md>)

[Implementation](<https://github.com/YuanGongND/ltu>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### SAM-130M

Sound Score: 11.41. Result ID: 69aa7e206dbb7075b953c772.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"130M"}. This record does not assert independent reproduction.

### SAM-780M

Sound Score: 9.01. Result ID: 69aa7e206dbb7075b953c771.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b721e209131cea8883d.md>)

Recorded evaluation configuration: {"Size":"780M"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.