Visual Understanding on 18 Visual Understanding Assessments VLMEvalKit
48.25AVE@18Und.MMAR-7B
Evaluation results
| Method | Links | |
|---|---|---|
| MMAR-7BType=Joint Prob. Models, LLM=Qwen-2-7B, V-Token=vae, Resolution=2562024.10 | 48.25 | |
| LLaVA-1.5Type=Und. Only, LLM=Vicuna-1.5-7B, V-Token=CLIP, Resolution=3362024.10 | 47.08 | |
| MMAR-0.5BType=Joint Prob. Models, LLM=Qwen-2-0.5B, V-Token=vae, Resolution=2562024.10 | 34.56 | |
| Show-oType=Joint Prob. Models, LLM=Phi-1.5B, V-Token=CLIP, Resolution=3362024.10 | 33.06 | |
| Transfusion*Type=Joint Prob. Models, LLM=Qwen-2-0.5B, V-Token=vae, Resolution=2562024.10 | 28.26 | |
| Chameleon-7BType=Joint Prob. Models, LLM=7B from scratch, V-Token=vq-vae, Resolution=5122024.10 | 18.34 |