MME
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MME Total Scores
590MME Score (Zh)
6
MME Position
48.3Score (Zh)
6
MME Color
170Score (Chinese)
6
MME Count
70MME Count (Zh)
6
MME Existence
190Zh Score
6
MME Perception
1,682Perception Score
5
MME-RealWorld
43.7Reasoning
5
MME (test)
2,392MME-S Score
5
MME (test)
1,511Perception Score
5
MME (test)
1,515.4MME Score
5
MME-P (test)
1,554Perception Score
4
MME-RealWorld
67.7Accuracy
4
MME
60.24MME Score
4
MME
88.08Accuracy
4
MME
1,905.1MME Perception + Reasoning Score
4
MME
165Count Score
4
MME
357.5Conceptual Score (C)
4
MME-Realworld
60.5Accuracy
4
MME (val)
97.57AUPRC
4
MME
1,414P-score
4
MME-RW
31.9Accuracy
4
MME Summary
1,796.6MME Summary Score
4
MME
94.06Score
4
MME Perception
1,552.5MME Score
4
MME
1,692Score
3