Multiple-Choice Question Answering on Image Implication Multiple-Choice 1.0 (test)
78AccuracyGemini-2.5-flash-thinking
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-2.5-flash-thinking2026.02 | 78 | |
| MetaphorStar-32BParameters=32B2026.02 | 78 | |
| Gemini-2.5-flash2026.02 | 76 | |
| Gemini-3.0-pro2026.02 | 76 | |
| GPT-4o2026.02 | 74 | |
| GPT-4.12026.02 | 74 | |
| Grok-3-reasoning2026.02 | 74 | |
| MetaphorStar-7BParameters=7B2026.02 | 74 | |
| QwenVL-2.5-72BParameters=72B2026.02 | 72 | |
| InternVL3-78BParameters=78B2026.02 | 70 | |
| Claude-3.5-Sonnet2026.02 | 68 | |
| Grok-32026.02 | 66 | |
| Doubao-1.5-thinking-vision-pro2026.02 | 66 | |
| GLM-4V-plus2026.02 | 64 | |
| MetaphorStar-3BParameters=3B2026.02 | 64 | |
| QwenVL-2.5-32BParameters=32B2026.02 | 62 | |
| QVQ-72BParameters=72B2026.02 | 62 | |
| GLM-4.1V-8BParameters=8B2026.02 | 60 | |
| Claude-4.0-Sonnet2026.02 | 60 | |
| o4-mini2026.02 | 58 | |
| QwenVL-2.5-3BParameters=3B2026.02 | 48 | |
| QwenVL-2.5-7BParameters=7B2026.02 | 46 | |
| DeepSeek-VL22026.02 | 46 | |
| GPT-4o-mini2026.02 | 44 | |
| LLaVA-1.5-7BParameters=7B2026.02 | 16 |