List your company
ResearchFormerly WizWand

Multimodal Understanding on MM-Vet v2

71.8MM-Vet v2 ScoreClaude3.5-Sonnet
18.86432.60746.3560.093Dec 2, 2024Jan 15, 2025Mar 1, 2025Apr 14, 2025May 29, 2025Jul 12, 2025Aug 26, 2025
Updated 7mo ago

Evaluation results

MethodLinks
Claude3.5-Sonnet2024.1271.8
GPT-4o (0806)Model Version=08062024.1271
VLSI-7BSize=7B2024.1270
Qwen2-VL-72BSize=72B2024.1268.7
InternVL2-76BSize=76B2024.1268.4
Gemini-1.5-Pro2024.1266.9
GPT-4V (0409)Model Version=04092024.1266.3
NDBackbone Model=Qwen3-VL2025.0866
NDModel=Qwen3-VL, Note=no-defense baseline2025.0866
PRISMBackbone Model=Qwen3-VL2025.0862.5
PRISMModel=Qwen3-VL2025.0862.5
VLSI-2BSize=2B2024.1260.8
Phantom-7BSize=7B2024.1260.6
NDBackbone Model=Qwen2.5-VL2025.0859
NDModel=Qwen2.5-VL, Note=no-defense baseline2025.0859
LLaVA-NeXT-34BSize=34B2024.1250.9
PRISMBackbone Model=Qwen2.5-VL2025.0849.2
PRISMModel=Qwen2.5-VL2025.0849.2
Phantom-1.8BSize=1.8B2024.1246.3
PRISMBackbone Model=LLaVA-1.62025.0827.9
PRISMModel=LLaVA-1.62025.0827.9
NDBackbone Model=LLaVA-1.62025.0820.9
NDModel=LLaVA-1.6, Note=no-defense baseline2025.0820.9