Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MMMU dataset and benchmarks – Page 9 · SOTA2 Research

Research Datasets

MMMU

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Multi-discipline Visual Reasoning

MMMU (val)

29.44Accuracy

3

Multimodal Understanding

MMMU-HM

0.673Accuracy

3

Multimodal Understanding

MMMU

44.51Art Score

2

Multimodal Understanding

MMMU

37.3Accuracy (Noise)

2

Multi-discipline Multi-modal Understanding

MMMU

50Accuracy (Noise)

2

Multimodal Vision Evaluation

MMMU-Pro

79.06Accuracy

2

Multimodal Understanding

MMMU

25,025Total Inference Time (s)

2

Close/open-ended VQA

MMMU HM

67.3Accuracy

2

Page 9 of 9

Popular tasks

Multimodal Understanding Multimodal Reasoning Multi-discipline Reasoning Visual Reasoning Medical Visual Question Answering

Follow for updates

Join SOTA2 Contact