List your company

Multimodal Evaluation Suite

Benchmarks

TaskDatasetSOTA resultTrendResults
Multimodal Evaluation Suite (GQA, MMBench, MMBench-CN, MME, POPE, SEED-Bench, TextVQA, VizWiz, OCRBench)
61.5GQA Score
21
Multimodal Evaluation Suite (Tiny-ImageNet, CIFAR-100, FMNIST, Caltech-256, AG News, MMLU, VQA, CommonGen) (test)
100Significance Rate (TAP Better)
18
Multimodal Evaluation Suite GQA, MMBench, MMBench-CN, MME, POPE, ScienceQA, TextVQA (various)
62.2GQA Accuracy
16