Multimodal Reasoning on Hallusion
63.51ScoreLlamaV-o1
Evaluation results
| Method | Links | |
|---|---|---|
| LlamaV-o1Model Source=Our Models2025.01 | 63.51 | |
| GPT-4o-0806Model Source=Close-Source2025.01 | 54.2 | |
| Mulberry-7BModel Source=Open-Source2025.01 | 54.1 | |
| Claude3.5-Sonnet-0620Model Source=Close-Source2025.01 | 49.9 | |
| Ovis1.5-Gemma2-9BModel Source=Open-Source2025.01 | 48.2 | |
| MiniCPM-V2.6-8BModel Source=Open-Source2025.01 | 48.1 | |
| Llava-CoTModel Source=Open-Source2025.01 | 47.8 | |
| GPT-4o-mini-0718Model Source=Close-Source2025.01 | 46.1 | |
| Gemini-1.5-ProModel Source=Close-Source2025.01 | 45.6 | |
| InternVL2-8BModel Source=Open-Source2025.01 | 45 | |
| Llama-3.2-90B-Vision-InstModel Source=Open-Source2025.01 | 44.1 | |
| VILA-1.5-40BModel Source=Open-Source2025.01 | 40.9 | |
| Llama-3.2-11B-Vision-InstModel Source=Our Models, Note=baseline2025.01 | 40.3 |