Multimodal Benchmarks
Benchmarks
TaskDatasetSOTA resultTrendResults
Multimodal Benchmarks MME, OCRBench, DocVQA, RealWorldQA, VLMBlind
2,386MME Score
33
9 Multimodal Benchmarks (VQAv2, GQA, VizWiz, SQA-IMG, TextVQA, POPE, MME, MMB, MMB-CN) (test val)
80VQAv2 Accuracy
15
Multimodal Benchmarks Aggregate
101.7Relative Performance
13
Average of 10 Multimodal Benchmarks
72.15Average Score
9
Multimodal Benchmarks Average
67.2Accuracy
9