Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Multimodal Understanding research benchmarks – Page 6 · SOTA2 Research

Multimodal Understanding

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

60.2RWQA Score

14

May 13, 2026

4.44ECE

14

Apr 21, 2026

79.36MMSU Score

14

May 28, 2026

99.84Accuracy

14

Apr 9, 2026

96.33Accuracy

14

Apr 9, 2026

100Accuracy

14

Apr 9, 2026

GPT4V-Caption (IOD)

100Accuracy

14

Apr 9, 2026

66.1Absolute Score

14

Mar 17, 2026

Multiple Datasets Aggregate

79.09Average Score

14

Mar 4, 2026

MMMU 1.0 (test)

50.6MMMU Score

14

Feb 26, 2026

MMBench v1.0 (test)

67.7Accuracy

14

Feb 26, 2026

Multimodal Evaluation Suite (MME, TextVQA, DocVQA, AI2D, MMMU, MMBench)

1,687.9MME Score

13

Jul 9, 2026

Multimodal Benchmarks Aggregate

101.7Relative Performance

13

Jun 1, 2026

SEED-Bench-I Image Subset

71Accuracy

13

May 29, 2026

77Score

13

May 13, 2026

Aggregate Image and Video Benchmarks

100RelAcc

13

Apr 13, 2026

193.2Relative Speed (RelSpd)

13

Apr 13, 2026

62.6MMBench English Score

13

Mar 4, 2026

Benchmark Agent 1.0 (test)

72.19Medical Accuracy

12

Jun 5, 2026

65.5LLaVA-B Score

12

May 29, 2026

LLaVA-OneVision

77.2NaturalBench Score

12

May 20, 2026

MLLM Evaluation Suite GQA MME POPE SQA VQAtext VizWiz MMBen AI2D v1.5 v1.6 Qwen2.5 (test)

64.8GQA Score

12

Apr 21, 2026

MMMU-Pro 1.0 (test)

Vanilla (Full Tokens)

44.39Overall Score

12

Apr 15, 2026

Opencompass Image Benchmark (val)

84MMBench Accuracy

12

Apr 14, 2026

57.6MMMU Score

12

May 20, 2026

Page 6 of 12

Popular datasets

MMBench MMMU MME SEED-Bench MM-Vet

Follow for updates

Join SOTA2 Contact