MME-RealWorld
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MME-RealWorld Lite
51.49Score
6
MME-RealWorld en
63.2Score
6
MME-RealWorld Lite
55.1Accuracy
5
MME-RealWorld Lite
3.2Average Time per Sample (s)
5
MME-Realworld ID
60.5Overall Score
5
MME-RealWorld
62.31Score
4
MME-RealWorld Lite (test)
83.6OCR
3
MME-RealWorld
63.8Score
2
MME-RealWorld zero-shot
48.03Zero-shot Accuracy
2