Standard Multimodal Evaluation Suite
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Standard Multimodal Evaluation Suite (GQA, MMBench, MME, TextVQA, ScienceQA, VQA v2) 1.5 (test val)
63.2GQA Score
32
Standard Multimodal Evaluation Suite GQA, MMB, MME, VQA-T, SQA-I, VQA-v2, POPE, MMMU, MM-Vet
61.9GQA Accuracy
26