List your company

ResearchFormerly WizWand

MME-RealWorld

Benchmarks

TaskDatasetSOTA resultTrendResults

Fine-grained Perception

MME-RealWorld Lite

51.49Score

6

General Visual Question Answering

MME-RealWorld en

63.2Score

6

Multimodal Agent Performance

MME-RealWorld Lite

55.1Accuracy

5

Efficiency Evaluation

MME-RealWorld Lite

3.2Average Time per Sample (s)

5

Multimodal Perception and Reasoning

MME-Realworld ID

60.5Overall Score

5

Multimodal Perception

MME-RealWorld

62.31Score

4

MME-RealWorld Lite (test)

83.6OCR

3

General Visual Understanding

MME-RealWorld

63.8Score

2

Multimodal Evaluation

MME-RealWorld zero-shot

48.03Zero-shot Accuracy

2