Safety Evaluation on FigStep (ASR)
0.6ASRMoRAS
Evaluation Results
| Method | Links | |
|---|---|---|
| MoRASModel=Qwen-VL-Chat2025.10 | 0.6 | |
| SafeSteerModels=Qwen3-VL2026.05 | 0.6 | |
| SafeSteerModels=Qwen2.5-VL2026.05 | 1.8 | |
| AutoSteerModel=LLaVA-OneVision-7B2025.10 | 2.3 | |
| MoRASModel=LLaVA-1.5-7B2025.10 | 2.8 | |
| MoRASModel=LLaVA-OneVision-7B2025.10 | 3.4 | |
| CoCAModel=LLaVA-OneVision-7B2025.10 | 6 | |
| ETAModel=InternLM-XComposer-2.52025.10 | 6 | |
| FigStepModel=LLaVA-OneVision-7B2025.10 | 6.6 | |
| MRDModels=Qwen3-VL2026.05 | 6.6 | |
| FigStepModel=InternLM-XComposer-2.52025.10 | 7 | |
| MoRASModel=InternLM-XComposer-2.52025.10 | 7.2 | |
| ETAModel=LLaVA-1.5-7B2025.10 | 7.8 | |
| ETAModel=Qwen-VL-Chat2025.10 | 9.2 | |
| ASTRAModel=LLaVA-OneVision-7B2025.10 | 10 | |
| MLLM-ProtectorModels=Qwen3-VL2026.05 | 11.2 | |
| VanillaModels=Qwen3-VL2026.05 | 12.6 | |
| ECSOModels=Qwen3-VL2026.05 | 13.2 | |
| ETAModel=LLaVA-OneVision-7B2025.10 | 14 | |
| ASTRAModel=LLaVA-1.5-7B2025.10 | 14.2 | |
| ASTRAModel=InternLM-XComposer-2.52025.10 | 14.6 | |
| MLLM-ProtectorModels=Qwen2.5-VL2026.05 | 14.6 | |
| AutoSteerModel=InternLM-XComposer-2.52025.10 | 15.8 | |
| CoCAModel=InternLM-XComposer-2.52025.10 | 16 | |
| ECSOModel=InternLM-XComposer-2.52025.10 | 16.6 | |
| ECSOModel=LLaVA-OneVision-7B2025.10 | 17.8 | |
| VanillaModel=LLaVA-OneVision-7B2025.10 | 22 | |
| VanillaModel=InternLM-XComposer-2.52025.10 | 22.6 | |
| SafeSteerModels=LLaVA-1.5-7b2026.05 | 23.4 | |
| ECSOModels=LLaVA-1.5-7b2026.05 | 25.4 | |
| ECSOModels=Qwen2.5-VL2026.05 | 25.4 | |
| ASTRAModel=Qwen-VL-Chat2025.10 | 28.8 | |
| CoCAModel=Qwen-VL-Chat2025.10 | 32.2 | |
| MLLM-ProtectorModels=LLaVA-1.5-7b2026.05 | 34.4 | |
| VanillaModels=Qwen2.5-VL2026.05 | 35.2 | |
| ECSOModel=LLaVA-1.5-7B2025.10 | 37.4 | |
| MRDModels=LLaVA-1.5-7b2026.05 | 40.2 | |
| VanillaModels=LLaVA-1.5-7b2026.05 | 42.8 | |
| FigStepModel=Qwen-VL-Chat2025.10 | 44.4 | |
| ECSOModel=Qwen-VL-Chat2025.10 | 45.4 | |
| AutoSteerModel=Qwen-VL-Chat2025.10 | 46.4 | |
| MRDModels=Qwen2.5-VL2026.05 | 49.6 | |
| CoCAModel=LLaVA-1.5-7B2025.10 | 51.6 | |
| FigStepModel=LLaVA-1.5-7B2025.10 | 52 | |
| VanillaModel=Qwen-VL-Chat2025.10 | 52.4 | |
| AutoSteerModel=LLaVA-1.5-7B2025.10 | 55 | |
| VanillaModel=LLaVA-1.5-7B2025.10 | 59.3 |