List your company

Multimodal Question Answering on CCBench

41.2ScoreQwen-VL-Chat
-0.19210.55421.332.046May 30, 2024

Evaluation results

MethodLinks
Qwen-VL-ChatSize=9.6B, Visual Tokens=256, GFLOPs=37542024.0541.2
VLORASize=7.8B, Visual Tokens=0, GFLOPs=6192024.0528.6
LLaVA-v1.5Size=7.2B, Visual Tokens=576, GFLOPs=80272024.0527.5
InstructBLIPSize=8B, Visual Tokens=32, GFLOPs=8272024.0512.7
Idefics-instructSize=9B, Visual Tokens=64, GFLOPs=13622024.057.8
OpenFlamingo v2Size=9B, Visual Tokens=64, GFLOPs=13622024.056.3
Qwen-VLSize=9.6B, Visual Tokens=256, GFLOPs=37542024.056.1
MiniGPT-4-v1Size=7B, Visual Tokens=32, GFLOPs=8272024.051.8
MiniGPT-4-v2Size=7B, Visual Tokens=256, GFLOPs=37542024.051.4