Human Preference Alignment on MM-AlignBench 1.0 (test)
84.9Win RateClaude3.5V-Sonnet
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Claude3.5V-Sonnet2025.02 | 84.9 | 51.4 | 70 | 144 | 12 | 31 | 4 | |
| GPT-4V2025.02 | 82.5 | 46 | 57 | 157 | 12 | 31 | 1 | |
| GPT-4o2025.02 | 81.3 | 49 | 81 | 124 | 12 | 31 | 4 | |
| GeminiFlash1.5-0022025.02 | 77 | 39.1 | 56 | 138 | 14 | 35 | 9 | |
| LLaVANext-OA-32B-DPOAlignment Stage=SFT+DPO, Dataset=OmniAlign-V + OmniAlign-V-DPO2025.02 | 72.6 | 33.5 | 49 | 138 | 20 | 40 | 5 | |
| LLaVANext-OA-32BAlignment Stage=SFT, Dataset=OmniAlign-V2025.02 | 62.3 | 19.4 | 31 | 126 | 19 | 62 | 14 | |
| Qwen2VL-72B2025.02 | 61.5 | 21.6 | 43 | 112 | 15 | 75 | 7 | |
| Claude-3V-Sonnet2025.02 | 50 | 0 | — | — | — | — | — | |
| Qwen2VL-7B2025.02 | 44.4 | -5.8 | 28 | 84 | 5 | 101 | 34 | |
| InternVL2-72B2025.02 | 44.4 | -6.9 | 19 | 93 | 8 | 98 | 34 | |
| InternVL2-8B-MPO2025.02 | 40.1 | -10.9 | 26 | 75 | 10 | 100 | 41 | |
| InternVL2-8B2025.02 | 31.3 | -21.8 | 18 | 61 | 15 | 109 | 49 | |
| LLaMA3.2-Vision-11B2025.02 | 27.8 | -33.7 | 18 | 52 | 4 | 98 | 80 | |
| LLaVANext-Qwen32B2025.02 | 26.6 | -29 | 16 | 51 | 10 | 121 | 54 | |
| LLaVA-OneVision-7B2025.02 | 23.8 | -46.2 | 14 | 46 | 1 | 75 | 116 | |
| MiniCPM-V-2.52025.02 | 12.7 | -53 | 9 | 23 | 8 | 116 | 96 | |
| Xcomposer2.5-7B2025.02 | 7.5 | -74 | 5 | 14 | 3 | 63 | 167 | |
| Idefics3-8B2025.02 | 2.7 | -92.3 | 3 | 4 | 0 | 15 | 230 |