College-level Multimodal Question Answering on MMMU
37Overall ScoreQwen-VL-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-VL-ChatSize=9.6B, Visual Tokens=256, GFLOPs=37542024.05 | 37 | |
| VLORASize=7.8B, Visual Tokens=0, GFLOPs=6192024.05 | 36 | |
| LLaVA-v1.5Size=7.2B, Visual Tokens=576, GFLOPs=80272024.05 | 35.7 | |
| InstructBLIPSize=8B, Visual Tokens=32, GFLOPs=8272024.05 | 30.6 | |
| Qwen-VLSize=9.6B, Visual Tokens=256, GFLOPs=37542024.05 | 29.6 | |
| OpenFlamingo v2Size=9B, Visual Tokens=64, GFLOPs=13622024.05 | 28.2 | |
| MiniGPT-4-v2Size=7B, Visual Tokens=256, GFLOPs=37542024.05 | 25 | |
| MiniGPT-4-v1Size=7B, Visual Tokens=32, GFLOPs=8272024.05 | 23.6 | |
| Idefics-instructSize=9B, Visual Tokens=64, GFLOPs=13622024.05 | 18.4 |