Multi-instruction Visual Reasoning on MM4
172ScoreQwen2.5-vl-max
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-vl-maxn (scoring scheme)=12026.03 | 172 | |
| GPT-4on (scoring scheme)=12026.03 | 170 | |
| LLaVA-1.5-3Bn (scoring scheme)=12026.03 | 165 | |
| iGVLM-3Bn (scoring scheme)=12026.03 | 164 | |
| QA-ViT-13Bn (scoring scheme)=12026.03 | 163 | |
| QA-ViT-7Bn (scoring scheme)=12026.03 | 162 | |
| GPT-4vn (scoring scheme)=12026.03 | 161 | |
| iGVLM-13Bn (scoring scheme)=12026.03 | 161 | |
| LLaVA1.5-13Bn (scoring scheme)=12026.03 | 161 | |
| iGVLM-7Bn (scoring scheme)=12026.03 | 161 | |
| LLaVA1.5-7Bn (scoring scheme)=12026.03 | 157 | |
| Qwen2.5-vl-maxn (scoring scheme)=22026.03 | 149 | |
| GPT-4on (scoring scheme)=22026.03 | 138 | |
| LLaVA-1.5-3Bn (scoring scheme)=22026.03 | 130 | |
| iGVLM-3Bn (scoring scheme)=22026.03 | 124 | |
| GPT-4vn (scoring scheme)=22026.03 | 120 | |
| iGVLM-13Bn (scoring scheme)=22026.03 | 117 | |
| QA-ViT-13Bn (scoring scheme)=22026.03 | 115 | |
| Qwen2.5-vl-maxn (scoring scheme)=32026.03 | 114 | |
| LLaVA1.5-13Bn (scoring scheme)=22026.03 | 113 | |
| LLaVA1.5-7Bn (scoring scheme)=22026.03 | 113 | |
| iGVLM-7Bn (scoring scheme)=22026.03 | 109 | |
| QA-ViT-7Bn (scoring scheme)=22026.03 | 108 | |
| GPT-4on (scoring scheme)=32026.03 | 107 | |
| LLaVA-1.5-3Bn (scoring scheme)=32026.03 | 82 | |
| iGVLM-3Bn (scoring scheme)=32026.03 | 78 | |
| LLaVA1.5-13Bn (scoring scheme)=32026.03 | 77 | |
| iGVLM-13Bn (scoring scheme)=32026.03 | 71 | |
| QA-ViT-13Bn (scoring scheme)=32026.03 | 68 | |
| GPT-4vn (scoring scheme)=32026.03 | 66 | |
| LLaVA1.5-7Bn (scoring scheme)=32026.03 | 61 | |
| QA-ViT-7Bn (scoring scheme)=32026.03 | 59 | |
| GPT-4on (scoring scheme)=42026.03 | 58 | |
| iGVLM-7Bn (scoring scheme)=32026.03 | 58 | |
| Qwen2.5-vl-maxn (scoring scheme)=42026.03 | 52 | |
| iGVLM-3Bn (scoring scheme)=42026.03 | 29 | |
| LLaVA-1.5-3Bn (scoring scheme)=42026.03 | 27 | |
| GPT-4vn (scoring scheme)=42026.03 | 24 | |
| iGVLM-13Bn (scoring scheme)=42026.03 | 23 | |
| QA-ViT-13Bn (scoring scheme)=42026.03 | 21 | |
| LLaVA1.5-13Bn (scoring scheme)=42026.03 | 18 | |
| iGVLM-7Bn (scoring scheme)=42026.03 | 17 | |
| LLaVA1.5-7Bn (scoring scheme)=42026.03 | 13 | |
| QA-ViT-7Bn (scoring scheme)=42026.03 | 11 |