List your company

Vision Understanding on RealworldQA

75.4Overall ScoreGPT-4o-0513
56.6861.5466.471.26Sep 7, 2024Oct 19, 2024Nov 30, 2024Jan 12, 2025Feb 23, 2025Apr 6, 2025May 19, 2025

Evaluation results

MethodLinks
GPT-4o-05132024.0975.4
OneVision2024.0969.9
Qwen2.5-VLSize=7.0B, Capability=Und. only2025.0568.9
MetaMorphSize=8.0B, Capability=Und. and Gen.2025.0568.8
MindOmniSize=7.0B, Capability=Und. and Gen.2025.0568.1
IXC-2.52024.0967.8
POINTS-7BLLM=Qwen-2.5-7B2024.0967.3
Cambrian-34B2024.0967.1
LLaVA-OVSize=7.0B, Capability=Und. only2025.0566.8
POINTS-9BLLM=Yi-1.5-9B2024.0965.9
Ovis1.5-LLAMA3-8B2024.0964.2
InternVL2-8B2024.0964.2
Gemini-1.5-Pro2024.0964.1
Idefics3-LLAMA3-8B2024.0962.6
Claude3.5-Sonnet2024.0960.1
TokenFlow-XLSize=14B, Capability=Und. and Gen.2025.0558.3
Emu3-ChatSize=8.0B, Capability=Und. only2025.0557.4