List your company
ResearchFormerly WizWand

Multimodal Audio Reasoning on MMAR

63.5Mean ScoreGPT-4o Audio
4.32419.68735.0550.413Mar 10, 2026
Updated 7mo ago

Evaluation results

MethodLinks
GPT-4o Audio2026.0363.5
Audio Flamingo 3Size=8B, No LLM Modification=×, # Samples=26.7M, # Hours=54.4K2026.0358.5
Qwen2.5-OmniSize=7B, No LLM Modification=×, # Tokens=0.3T2026.0356.7
DeSTA-2.5-AudioSize=8B, No LLM Modification=✓, # Samples=5M, # Hours=7K2026.0350.8
GPT-4o mini Audio2026.0350.6
AL-Whisper-Instruct-RSize=4B, No LLM Modification=✓, # Samples=0.5M, # Hours=1K, # Tokens=91M2026.0349.1
ALARM-ESize=4B, No LLM Modification=✓, # Samples=5.5M, # Hours=17K, # Tokens=1.5B2026.0348.7
ALARM-PSize=4B, No LLM Modification=✓, # Samples=5.5M, # Hours=17K, # Tokens=1.5B2026.0343.5
ALARM-CASize=4B, No LLM Modification=✓, # Samples=5.5M, # Hours=17K, # Tokens=1.5B2026.0340.6
AL-W2VBERT2-RSize=4B, No LLM Modification=✓, # Samples=0.5M, # Hours=0.6K, # Tokens=58M2026.0337.4
AL-Whisper-RSize=4B, No LLM Modification=✓, # Samples=5.5M, # Hours=17K, # Tokens=1.5B2026.0337.3
Audio ReasonerSize=8B, No LLM Modification=×, # Samples=> 1.2M, # Hours=> 320K2026.0336.8
AL-MuQ-RSize=4B, No LLM Modification=✓, # Samples=0.4M, # Hours=1.5K, # Tokens=137M2026.0336
AL-SSLAM-RSize=4B, No LLM Modification=✓, # Samples=0.4M, # Hours=1.2K, # Tokens=108M2026.0333.8
SALMONNSize=13B, No LLM Modification=×, # Samples=2.3M, # Hours=4.4K2026.0333.2
Qwen2-Audio-InstructSize=7B, No LLM Modification=×, # Hours=320K2026.0330
GAMASize=7B, No LLM Modification=×, # Samples=6.3M2026.0326.5
Audio Flamingo 2Size=3B, No LLM Modification=×, # Samples=5.9M2026.0321.9
LTUSize=7B, No LLM Modification=×, # Samples=5.6M2026.0319.2
GAMA-ITSize=7B, No LLM Modification=×, # Samples=6.5M2026.0317.4
MU-LLaMASize=7B, No LLM Modification=✓, # Samples=0.1M, # Hours=762026.0313.9
MusiLingoSize=7B, No LLM Modification=✓, # Samples=0.7M2026.036.6