Jailbreak Defense on LLaVA v1.5
3.18ASRNullSteer
Evaluation results
| Method | Links | |
|---|---|---|
| NullSteerepsilon=16/2552026.03 | 3.18 | |
| ASTRAepsilon=16/2552026.03 | 4.55 | |
| NullSteerepsilon=32/2552026.03 | 8.75 | |
| NullSteerepsilon=unconstrained2026.03 | 10.25 | |
| ASTRAepsilon=32/2552026.03 | 10.91 | |
| NullSteerepsilon=64/2552026.03 | 11.48 | |
| ASTRAepsilon=unconstrained2026.03 | 12.43 | |
| Benign imageepsilon=16/2552026.03 | 13.64 | |
| Benign imageepsilon=32/2552026.03 | 13.64 | |
| Benign imageepsilon=64/2552026.03 | 13.64 | |
| Benign imageepsilon=unconstrained2026.03 | 13.64 | |
| ASTRAepsilon=64/2552026.03 | 13.64 | |
| ECSOepsilon=64/2552026.03 | 14.55 | |
| JailGuardepsilon=unconstrained2026.03 | 17.27 | |
| Jailbreak Templatesepsilon=32/2552026.03 | 17.27 | |
| Refusal Pairsepsilon=unconstrained2026.03 | 19.09 | |
| ECSOepsilon=unconstrained2026.03 | 20 | |
| Refusal Pairsepsilon=64/2552026.03 | 20 | |
| Jailbreak Templatesepsilon=64/2552026.03 | 20 | |
| JailGuardepsilon=32/2552026.03 | 21.82 | |
| ECSOepsilon=32/2552026.03 | 21.82 | |
| Self-reminderepsilon=64/2552026.03 | 22.73 | |
| Self-reminderepsilon=unconstrained2026.03 | 22.73 | |
| JailGuardepsilon=16/2552026.03 | 23.64 | |
| Refusal Pairsepsilon=16/2552026.03 | 23.64 | |
| Jailbreak Templatesepsilon=16/2552026.03 | 23.64 | |
| ECSOepsilon=16/2552026.03 | 24.55 | |
| Refusal Pairsepsilon=32/2552026.03 | 25.45 | |
| Self-reminderepsilon=16/2552026.03 | 28.18 | |
| Jailbreak Templatesepsilon=unconstrained2026.03 | 29.09 | |
| Self-reminderepsilon=32/2552026.03 | 30 | |
| JailGuardepsilon=64/2552026.03 | 30 | |
| w/o defenseepsilon=16/2552026.03 | 51.82 | |
| w/o defenseepsilon=unconstrained2026.03 | 53.64 | |
| w/o defenseepsilon=64/2552026.03 | 55.45 | |
| w/o defenseepsilon=32/2552026.03 | 56.36 |