Multimodal Vision-Language Evaluation on MMStar 1.0 (test)
69.6Contrastive Prediction ScoreMeteor-7B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Meteor-7BParameters=7B2024.05 | 69.6 | 45.6 | 63.6 | 53.2 | 42 | 42.8 | 52.8 | |
| InternVL1.2-40BParameters=40B2024.05 | 67.6 | 43.2 | 61.2 | 47.2 | 24 | 19.2 | 43.7 | |
| CogVLM-Chat-17BParameters=17B2024.05 | 66.8 | 36.8 | 49.2 | 31.2 | 23.6 | 11.6 | 36.5 | |
| LLaVA-NeXT-34BParameters=34B2024.05 | 66.4 | 52 | 62.4 | 46 | 32.4 | 53.6 | 52.1 | |
| SPHINX-MoE-7B×8Architecture=MoE, Parameters=7B×82024.05 | 58.4 | 40.8 | 47.6 | 35.2 | 19.2 | 32 | 38.9 | |
| Yi-VL-34BParameters=34B2024.05 | 53.2 | 31.2 | 52 | 32.4 | 12.4 | 35.2 | 36.1 |