List your company

Multimodal Reasoning on VRC-Bench 1.0 (test)

61.35Final ScoreClaude-3.5 Sonnet
47.88251.378554.87558.3715Jan 10, 2025

Evaluation results

MethodLinks
Claude-3.5 SonnetSource Type=Close-Source2025.0161.3572.12
Gemini-1.5 ProSource Type=Close-Source2025.0161.3572.12
Gemini-2.0 FlashSource Type=Close-Source2025.0161.1674.08
GPT-4oSource Type=Close-Source2025.0159.2876.68
LlamaV-01Source Type=Open-Source2025.0156.4968.93
GPT-4o miniSource Type=Close-Source2025.0156.3974.05
Gemini-1.5 FlashSource Type=Close-Source2025.0154.9971.86
Llava-CoTSource Type=Open-Source2025.0154.0966.21
MulberrySource Type=Open-Source2025.0151.963.86
Llama-3.2 VisionSource Type=Open-Source2025.0148.458.37