Multimodal Evaluation on SEED-Bench SEED^I Image-only
72.5AccuracyCogVLM-17B
Evaluation Results
| Method | Links | |
|---|---|---|
| CogVLM-17BPT tks.=256, Parm.=10B, Training set observed=false2024.07 | 72.5 | |
| CoS-7BPT tks.=80, Parm.=532M, Training set observed=false2024.07 | 68.9 | |
| Honeybee-13BPT tks.=256, Parm.=13B, Training set observed=false2024.07 | 68.2 | |
| LLaVA-1.5-13BPT tks.=576, Parm.=13B, Training set observed=false2024.07 | 68.1 | |
| Honeybee-7BPT tks.=144, Parm.=7B, Training set observed=false2024.07 | 64.5 | |
| Qwen-VLPT tks.=256, Parm.=8B, Training set observed=false2024.07 | 62.3 | |
| InstructBLIP-7BPT tks.=32, Parm.=188M, Training set observed=false2024.07 | 58.8 | |
| mPLUG-Owl2PT tks.=64, Parm.=7B, Training set observed=false2024.07 | 57.8 |