Model Ranking Correlation Analysis on MMMU (10%-50% subsets) benchmark leaderboard · SOTA2 Research

Model Ranking Correlation Analysis on MMMU (10%-50% subsets)

0.96Spearman Correlation (10% Subset)M2IRT

Evaluation Results

Method	Links
M2IRT2026.03		0.96	0.96	0.96	0.97	0.96
M3IRT2026.03		0.89	0.92	0.92	0.93	0.93
FlashEval2026.03		0.79	0.79	0.79	0.8	0.8
Random2026.03		0.77	0.8	0.82	0.82	0.81
IRT2026.03		0.5	0.36	0.38	0.35	0.12
TinyBenchmarks2026.03		0.43	0.5	0.56	0.61	0.67
MIRT2026.03		0.16	0.33	0.47	0.61	0.69