List your company
ResearchFormerly WizWand

Safety on MMSafetyBench

97.7Safety ScoreEcoAlign
36.02852.03968.0584.061Nov 14, 2025
Updated 7mo ago

Evaluation results

MethodLinks
EcoAlignCategory=Closed-source, Model=Gemini-2.5-Flash, Avg. Cost=24.12025.1197.7
EcoAlignCategory=Closed-source, Model=GPT-4o, Avg. Cost=21.22025.1196.5
EcoAlignCategory=Closed-source, Model=Qwen-VL-Max, Avg. Cost=12.72025.1193.8
EcoAlignCategory=Open-source, Model=InternVL3-14B, Avg. Cost=39.32025.1191.8
VLM-GuardCategory=Closed-source, Model=GPT-4o, Avg. Cost=3.12025.1188.4
VLM-GuardCategory=Closed-source, Model=Gemini-2.5-Flash, Avg. Cost=1.42025.1187.8
VLM-GuardCategory=Closed-source, Model=Qwen-VL-Max, Avg. Cost=2.22025.1187
VLM-GuardCategory=Open-source, Model=InternVL3-14B, Avg. Cost=1.92025.1185.9
EcoAlignCategory=Open-source, Model=Llama-3.2-11B-Vision, Avg. Cost=28.22025.1185.2
CoDCategory=Closed-source, Model=Gemini-2.5-Flash, Avg. Cost=27.52025.1181.3
CoTCategory=Closed-source, Model=Gemini-2.5-Flash, Avg. Cost=86.62025.1180
CoDCategory=Closed-source, Model=Qwen-VL-Max, Avg. Cost=34.32025.1179.3
CoTCategory=Closed-source, Model=Qwen-VL-Max, Avg. Cost=1142025.1179
CoDCategory=Open-source, Model=InternVL3-14B, Avg. Cost=45.52025.1178.4
CoTCategory=Open-source, Model=InternVL3-14B, Avg. Cost=134.22025.1176
CoDCategory=Closed-source, Model=GPT-4o, Avg. Cost=25.82025.1171.6
VLM-GuardCategory=Open-source, Model=Llama-3.2-11B-Vision, Avg. Cost=1.62025.1170.2
BaseCategory=Open-source, Model=InternVL3-14B, Avg. Cost=12025.1169.4
CoTCategory=Closed-source, Model=GPT-4o, Avg. Cost=104.32025.1169.1
BaseCategory=Closed-source, Model=Qwen-VL-Max, Avg. Cost=12025.1168.2
BaseCategory=Closed-source, Model=Gemini-2.5-Flash, Avg. Cost=12025.1164.2
BaseCategory=Closed-source, Model=GPT-4o, Avg. Cost=12025.1155.2
CoDCategory=Open-source, Model=Llama-3.2-11B-Vision, Avg. Cost=362025.1153.4
CoTCategory=Open-source, Model=Llama-3.2-11B-Vision, Avg. Cost=108.32025.1149.1
BaseCategory=Open-source, Model=Llama-3.2-11B-Vision, Avg. Cost=12025.1138.4