List your company
ResearchFormerly WizWand

Multi-modal Reasoning on MoMentS

72.26AccuracyGPT-4o
33.613643.646853.6863.7132Jul 27, 2025
Updated 6mo ago

Evaluation results

MethodLinks
GPT-4oStrategy=COCOT, Category=Standard VLMs2025.0772.26
Gemini-3.0-Flash*Strategy=COCOT, Category=Reasoning VLMs, Thinking mode=true2025.0771.31
GPT-4oStrategy=CCoT, Category=Standard VLMs2025.0770.79
GPT-4oStrategy=Direct, Category=Standard VLMs2025.0770.68
OpenAI o1-fullStrategy=COCOT, Category=Reasoning VLMs2025.0769.15
Gemini-3.0-Flash*Strategy=CCoT, Category=Reasoning VLMs, Thinking mode=true2025.0768.5
GPT-4oStrategy=CoT, Category=Standard VLMs2025.0768.12
OpenAI o1-fullStrategy=Direct, Category=Reasoning VLMs2025.0767.6
Gemini-3.0-Flash*Strategy=CoT, Category=Reasoning VLMs, Thinking mode=true2025.0766.8
OpenAI o1-fullStrategy=CCoT, Category=Reasoning VLMs2025.0766.5
Gemini-3.0-Flash*Strategy=Direct, Category=Reasoning VLMs, Thinking mode=true2025.0764.8
OpenAI o1-fullStrategy=CoT, Category=Reasoning VLMs2025.0764.19
Claude-3.5-SonnetStrategy=Direct, Category=Standard VLMs2025.0763.75
Claude-3.5-SonnetStrategy=COCOT, Category=Standard VLMs2025.0762.95
GPT-5.2-HighStrategy=Direct, Category=Reasoning VLMs2025.0762.95
GPT-5.2-HighStrategy=COCOT, Category=Reasoning VLMs2025.0762.55
GPT-5.2-HighStrategy=CoT, Category=Reasoning VLMs2025.0762.43
GPT-5.2-HighStrategy=CCoT, Category=Reasoning VLMs2025.0762.32
Claude-3.5-SonnetStrategy=CCoT, Category=Standard VLMs2025.0762
Claude-3.5-SonnetStrategy=CoT, Category=Standard VLMs2025.0761.35
Gemini-2.5-ProStrategy=COCOT, Category=Standard VLMs2025.0760
OpenAI o3-miniStrategy=COCOT, Category=Reasoning VLMs2025.0758
OpenAI o3-miniStrategy=Direct, Category=Reasoning VLMs2025.0756
Gemini-2.5-ProStrategy=CCoT, Category=Standard VLMs2025.0755.5
OpenAI o3-miniStrategy=CCoT, Category=Reasoning VLMs2025.0755.5
Gemini-2.5-ProStrategy=Direct, Category=Standard VLMs2025.0755
Gemini-2.5-ProStrategy=CoT, Category=Standard VLMs2025.0753
OpenAI o3-miniStrategy=CoT, Category=Reasoning VLMs2025.0752.94
LLaVA-v1.6-7BStrategy=Direct, Category=Open-Source VLMs2025.0750.2
Qwen2-VL-7BStrategy=Direct, Category=Open-Source VLMs2025.0749
LLaVA-OneVision-7BStrategy=CoT, Category=Open-Source VLMs2025.0748.21
LLaVA-v1.6-7BStrategy=COCOT, Category=Open-Source VLMs2025.0748
LLaVA-OneVision-7BStrategy=COCOT, Category=Open-Source VLMs2025.0746.22
LLaVA-v1.6-7BStrategy=CCoT, Category=Open-Source VLMs2025.0746
LLaVA-OneVision-7BStrategy=Direct, Category=Open-Source VLMs2025.0745.82
LLaVA-OneVision-7BStrategy=CCoT, Category=Open-Source VLMs2025.0745.5
Molmo-7BStrategy=COCOT, Category=Open-Source VLMs2025.0745.23
Molmo-7BStrategy=CCoT, Category=Open-Source VLMs2025.0744.03
Molmo-7BStrategy=Direct, Category=Open-Source VLMs2025.0744
LLaVA-v1.6-7BStrategy=CoT, Category=Open-Source VLMs2025.0744
Molmo-7BStrategy=CoT, Category=Open-Source VLMs2025.0742
Qwen2-VL-7BStrategy=COCOT, Category=Open-Source VLMs2025.0741.2
Qwen2-VL-7BStrategy=CCoT, Category=Open-Source VLMs2025.0740.87
Idefics3-8BStrategy=Direct, Category=Open-Source VLMs2025.0740
Idefics3-8BStrategy=COCOT, Category=Open-Source VLMs2025.0737.51
Qwen2-VL-7BStrategy=CoT, Category=Open-Source VLMs2025.0737.09
Idefics3-8BStrategy=CCoT, Category=Open-Source VLMs2025.0736.73
Idefics3-8BStrategy=CoT, Category=Open-Source VLMs2025.0735.1