Single-image Reasoning on MMStar
62.47AccuracyQwen2.5-VL + S2H-DPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-VL + S2H-DPOParameter=7B2026.04 | 62.47 | 73.03 | |
| Qwen2.5-VLParameter=7B2026.04 | 62.24 | 72.69 | |
| Qwen3-VL + S2H-DPOParameter=2B2026.04 | 53.62 | 69.54 | |
| Qwen3-VLParameter=2B2026.04 | 53.42 | 69.35 | |
| Idefics2Parameter=8B2026.04 | 49.5 | 67.85 | |
| Emu2-ChatParameter=37B2026.04 | 40.7 | 64.35 | |
| CogVLMParameter=17B2026.04 | 39.9 | 63.95 | |
| LLaVA-v1.6Parameter=7B2026.04 | 37.6 | 53.95 | |
| OpenFlamingoParameter=9B2026.04 | 36.9 | 44.75 | |
| LLaVA-v1.5 + POVIDParameter=7B2026.04 | 36.2 | 61.25 | |
| Qwen-VL-ChatParameter=7B2026.04 | 34.5 | 54.7 | |
| LLaVA-v1.5 + S2H-DPOParameter=7B2026.04 | 33.62 | 59.66 | |
| LLaVA-v1.5 + HA-DPOParameter=7B2026.04 | 33.5 | 58.9 | |
| LLaVA-v1.5Parameter=7B2026.04 | 32.9 | 59.4 | |
| LLaVA-v1.5 + MIA-DPOParameter=7B2026.04 | 32.9 | 60.05 | |
| InstructBLIPParameter=13B2026.04 | 32.7 | 59.4 | |
| LLaVA-v1.5 + LLaVA-RLHFParameter=7B2026.04 | 31.6 | 56.2 |