Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MMMU dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

MMMU

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Medical Visual Question Answering

MMMU Med

62.7Average Score

27

Multimodal Image Understanding

MMMU

54.2Score

26

Visual Question Answering

MMMU-Pro

49.27Accuracy

26

MMMU (val)

79.7Accuracy

26

Multimodal Understanding

MMMU zero-shot

73.67Zero-shot Accuracy

26

Multimodal Understanding

MMMU (dev)

67.3Accuracy

25

Medical Visual Question Answering

MMMU H&M

0.788Accuracy

25

Multimodal Reasoning

MMMU-Pro

55Std-10 Score

25

Visual Reasoning

MMMU-Pro

19.5Discriminability

24

Hallucination Detection

MMMU Pro

88.9AUC

24

Multi-discipline Multimodal Understanding

MMMU F

45.9Accuracy

23

Visual Reasoning

MMMU (val)

64.8Accuracy

22

General Visual Reasoning

MMMU

69.1Accuracy

22

General Utility

MMMU

69.1MMMU Score

21

Multimodal Reasoning

MMMU-Pro

51.1MMMU-Pro mean@8 Acc

21

General Multimodal Reasoning

MMMU-Pro

38.09Score

21

Multimodal Understanding

MMMU

80.89AUC Score

21

Multidisciplinary Knowledge

MMMU

69.1Score

21

Multi-discipline reasoning

MMMU-Pro

52.2Accuracy

21

Multimodal Reasoning

MMMU

55.06FEI Score

20

MMMU

75.1MMMU Score

20

Expert-level Multimodal Understanding

MMMU-Pro

67.1Accuracy

20

Multimodal Understanding

MMMU

38Accuracy

20

Multimodal Understanding

MMMU Pro

55.7Vis Accuracy

20

STEM & Reasoning

MMMU-Pro

81Accuracy

20

Page 3 of 9

Popular tasks

Multimodal Understanding Multimodal Reasoning Multi-discipline Reasoning Visual Reasoning Medical Visual Question Answering

Follow for updates

Join SOTA2 Contact