MME-RealWorld
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MME-RealWorld-Lite
73.06Accuracy
47
MME-RealWorld Lite
67Overall Score
46
MME-RealWorld Lite
67.3Overall Score
38
MME-RealWorld Lite
84OCR Score
37
MME-RealWorld-Lite (MMERW)
57Accuracy
31
MME-RealWorld
71.2Overall Score (P+P+P)
25
MME-RealWorld Lite
54.9Lite Score
25
MME-RealWorld Chinese
64.3Accuracy
25
MME-RealWorld English
59.9Accuracy
25
MME-RealWorld
71.2Accuracy
24
MME-RealWorld Lite
59.87Overall Score
21
MME-RealWorld Lite
54.3Overall Accuracy
21
MME-RealWorld EN
64Score
20
MME-RealWorld CN
73.31Accuracy
19
MME-RealWorld Lite
56.38Accuracy
19
MME-RealWorld-Lite 1.0 (test)
57.7Perception (AD) Acc
19
MME-RealWorld Lite
61.2Overall Score
18
MME-RealWorld-Lite (MRWL)
55.13Score
18
MME Realworld Lite
55.8Avg@1
12
MME-RealWorld Lite (test)
76OCR
12
MME-RealWorld-RS
58.15Position Score
11
MME-RealWorld Lite
57.8Score
10
MME-RealWorld Lite
57.4Overall Score
9
MME-RealWorld lite
49.87Accuracy
9
MME-RealWorld EN
74.9Hallucination Score
8