Multimodal Vision-Language Evaluation on MMStar 1.0 (test) benchmark leaderboard · SOTA2 Research

Multimodal Vision-Language Evaluation on MMStar 1.0 (test)

69.6Contrastive Prediction ScoreMeteor-7B

Evaluation Results

Method	Links
Meteor-7B2024.05		69.6	45.6	63.6	53.2	42	42.8	52.8
InternVL1.2-40B2024.05		67.6	43.2	61.2	47.2	24	19.2	43.7
CogVLM-Chat-17B2024.05		66.8	36.8	49.2	31.2	23.6	11.6	36.5
LLaVA-NeXT-34B2024.05		66.4	52	62.4	46	32.4	53.6	52.1
SPHINX-MoE-7B×82024.05		58.4	40.8	47.6	35.2	19.2	32	38.9
Yi-VL-34B2024.05		53.2	31.2	52	32.4	12.4	35.2	36.1