Speech Reasoning on MMAU Speech mini
75.08Speech ScoreGemini 2.5 Flash
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini 2.5 FlashSize=-2026.03 | 75.08 | |
| Qwen2.5-omni + Reasoning SFTSize=7B2026.03 | 74.47 | |
| TGSRSize=7B2026.03 | 74.47 | |
| Audio-ThinkerSize=8.4B2026.03 | 73.37 | |
| Qwen2.5-omni + Only STASize=7B2026.03 | 71.17 | |
| Qwen2.5-omniSize=7B2026.03 | 70.6 | |
| GPT-4o AudioSize=-2026.03 | 66.67 | |
| Audio Flamingo 3Size=7B2026.03 | 66.37 | |
| Audio-ReasonerSize=8.4B2026.03 | 66.07 | |
| Audio-CoTSize=8.4B2026.03 | 55.26 | |
| SALMONNSize=7B2026.03 | 26.43 |