Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MLLM-as-a-Judge dataset and benchmarks · SOTA2 Research

Research Datasets

MLLM-as-a-Judge

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

MLLM-as-a-Judge

75.78Accuracy

32

Multimodal Evaluation Consistency

MLLM-as-a-Judge

39.6CO Score

22

Large Multimodal Model Evaluation

MLLM-as-a-Judge v1.0 (test)

49Overall Score

16

Reward Modeling

MLLM-as-a-Judge (MaaJ)

72.18Accuracy

13

Human Consistency Evaluation

MLLM-as-a-Judge

30.3CO Consistency Score

11

Pointwise Scoring

MLLM-as-a-Judge in-domain v1.0 (test)

80.2ImageDC Score

9

Popular tasks

Reward Modeling Large Multimodal Model Evaluation Pointwise Scoring Human Consistency Evaluation VLM-as-a-Judge

Follow for updates

Join SOTA2 Contact