MLLM Safety Evaluation on OOD-MMSafe Standard Mode 1.0 (test)
1.35RAGemini-3-Pro
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Gemini-3-ProModel Type=Closed-source2026.03 | 1.35 | 29.7 | 1.31 | 30.8 | 1.79 | 0.7 | |
| GPT-5.1Model Type=Closed-source2026.03 | 1.18 | 34.5 | 1.17 | 37.8 | 1.85 | 0.4 | |
| Gemini-3-Pro-ThinkModel Type=Closed-source2026.03 | 1.12 | 40.9 | 1.09 | 42.4 | 1.71 | 1.1 | |
| Qwen3VL-32BModel Type=Open-source2026.03 | 0.88 | 51 | 0.82 | 55.6 | 1.7 | 2.9 | |
| Qwen3VL-8BModel Type=Open-source2026.03 | 0.87 | 52.5 | 0.91 | 50.8 | 1.61 | 3.7 | |
| o4-MiniModel Type=Closed-source2026.03 | 0.82 | 52.5 | 0.87 | 53 | 1.54 | 0.2 | |
| Gemma-3-12BModel Type=Open-source2026.03 | 0.81 | 53.6 | 0.69 | 60.7 | 1.61 | 1.5 | |
| Doubao-1.6Model Type=Closed-source2026.03 | 0.69 | 61.5 | 0.67 | 64 | 1.58 | 2.9 | |
| Qwen3VL-4BModel Type=Open-source2026.03 | 0.58 | 67.5 | 0.6 | 67.7 | 1.45 | 7.5 | |
| InternVL-3.5-38BModel Type=Open-source2026.03 | 0.24 | 82.4 | 0.32 | 89.6 | 1.08 | 4.4 | |
| QwenVL2.5-7BModel Type=Open-source2026.03 | 0.24 | 82.6 | 0.29 | 82.4 | 1.1 | 3.5 | |
| InternVL-3.5-8BModel Type=Open-source2026.03 | 0.13 | 89.2 | 0.19 | 87.7 | 1 | 7 | |
| LLaVA-1.5-7BModel Type=Open-source2026.03 | 0.09 | 92.3 | 0.15 | 89.7 | 0.86 | 16.5 |