MME
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MME SUM
2,494Score (SUM)
13
MME summary 2023
2,388Score
12
MME
78.53Utility (OpenAI)
12
MME
66.63Normalized Score
12
MME
657.86Cognition Score (C)
12
MME-RealWorld
71.4Score
12
MME (test)
94.9Score
12
MME
1,821.3Accuracy
12
MME
1,711.44Perception Score
12
MME Existence, Count, Position, Color
195Existence Score
12
MME Emotion
57.3ER-Lab
11
MME
590MME-C Score
11
MME CoT
64.2F1 Score
11
MME RealWorld
71.6Score
11
MME-P
1,687MME-P Score
11
MME (full)
1,531.3Composite Score
11
MME-RW
70.2Score
10
MME
1,579.6MME Score
10
MME
1,687MMEPerc Score
10
MME-RW-Lite
55.5Score
10
MME-RW
64.8Score
10
MME
1,845MME Score
10
MME RW-RS
43.63MME-RW-RS Score
10
MME
1,478.48Score
10
MME-P
1,284Rescaled Score
10