Multimodal Safety Evaluation on SIUO
5.39ASRCrossGuard
Evaluation results
| Method | Links | |
|---|---|---|
| CrossGuardCategory=MLLM Guardrails2025.10 | 5.39 | |
| Claude-3.5-SonnetCategory=Online MLLMs2025.10 | 23.95 | |
| Qwen2.5-VL-7BCategory=Offline MLLMs2025.10 | 41.56 | |
| HiddenDetectCategory=MLLM Guardrails2025.10 | 44.91 | |
| GPT-4oCategory=Online MLLMs2025.10 | 48.92 | |
| Llama-Guard3-VisionCategory=MLLM Guardrails2025.10 | 50.4 | |
| JailDAMCategory=MLLM Guardrails2025.10 | 81.44 | |
| LlavaGuardCategory=MLLM Guardrails2025.10 | 90.8 | |
| LLaVA-1.5-7B (base)Category=Offline MLLMs2025.10 | 95.81 |