Safety Evaluation on MM-SafetyBench v1.0 (test)
0.6ASRLLaVA-1.5-7B + Mixed-SFT
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaVA-1.5-7B + Mixed-SFTAttack Status=Before, Tuning Strategy=Full-parameter2025.03 | 0.6 | |
| LLaVA-1.5-7B + Posthoc-SFTAttack Status=Before, Tuning Strategy=Full-parameter2025.03 | 0.6 | |
| LLaVA-1.5-7B-LoRA + Mixed-SFTAttack Status=Before, Tuning Strategy=LoRA2025.03 | 0.6 | |
| LLaVA-1.5-7B-LoRA + Posthoc-SFTAttack Status=Before, Tuning Strategy=LoRA2025.03 | 0.6 | |
| LLaVA-1.5-7B + RMU-UnlearningAttack Status=Before, Tuning Strategy=Full-parameter2025.03 | 2.98 | |
| LLaVA-1.5-7B-LoRA + NPO-UnlearningAttack Status=Before, Tuning Strategy=LoRA2025.03 | 4.17 | |
| LLaVA-1.5-7B + NPO-UnlearningAttack Status=Before, Tuning Strategy=Full-parameter2025.03 | 4.76 | |
| LLaVA-1.5-7B-LoRA + RMU-UnlearningAttack Status=Before, Tuning Strategy=LoRA2025.03 | 5.36 | |
| LLaVA-1.5-7B + RMU-UnlearningAttack Status=After, Tuning Strategy=Full-parameter2025.03 | 17.26 | |
| LLaVA-1.5-7B-LoRA + RMU-UnlearningAttack Status=After, Tuning Strategy=LoRA2025.03 | 19.05 | |
| LLaVA-1.5-7B + NPO-UnlearningAttack Status=After, Tuning Strategy=Full-parameter2025.03 | 20.24 | |
| LLaVA-1.5-7B-LoRA + NPO-UnlearningAttack Status=After, Tuning Strategy=LoRA2025.03 | 23.81 | |
| LLaVA-1.5-7B + Posthoc-SFTAttack Status=After, Tuning Strategy=Full-parameter2025.03 | 40.48 | |
| LLaVA-1.5-7B-LoRA + Posthoc-SFTAttack Status=After, Tuning Strategy=LoRA2025.03 | 41.07 | |
| LLaVA-1.5-7BAttack Status=Before, Tuning Strategy=Full-parameter2025.03 | 48.81 | |
| LLaVA-1.5-7B + Mixed-SFTAttack Status=After, Tuning Strategy=Full-parameter2025.03 | 48.81 | |
| LLaVA-1.5-7B + Unsafe-FilterAttack Status=Before, Tuning Strategy=Full-parameter2025.03 | 50.6 | |
| LLaVA-1.5-7B-LoRAAttack Status=Before, Tuning Strategy=LoRA2025.03 | 57.74 | |
| LLaVA-1.5-7B-LoRA + Unsafe-FilterAttack Status=Before, Tuning Strategy=LoRA2025.03 | 58.93 | |
| LLaVA-1.5-7B-LoRA + Mixed-SFTAttack Status=After, Tuning Strategy=LoRA2025.03 | 63.69 | |
| LLaVA-1.5-7B + Unsafe-FilterAttack Status=After, Tuning Strategy=Full-parameter2025.03 | 90.28 | |
| LLaVA-1.5-7B-LoRA + Unsafe-FilterAttack Status=After, Tuning Strategy=LoRA2025.03 | 91.07 | |
| LLaVA-1.5-7BAttack Status=After, Tuning Strategy=Full-parameter2025.03 | 91.27 | |
| LLaVA-1.5-7B-LoRAAttack Status=After, Tuning Strategy=LoRA2025.03 | 93.45 |