Jailbreak Defense on MiniGPT-4
7.32Attack Success Rate (ASR)NullSteer
Evaluation results
| Method | Links | |
|---|---|---|
| NullSteerepsilon=unconstrained2026.03 | 7.32 | |
| NullSteerepsilon=16/2552026.03 | 7.62 | |
| ASTRAepsilon=16/2552026.03 | 9.09 | |
| ASTRAepsilon=unconstrained2026.03 | 9.09 | |
| NullSteerepsilon=32/2552026.03 | 10.72 | |
| ASTRAepsilon=32/2552026.03 | 13.18 | |
| NullSteerepsilon=64/2552026.03 | 13.58 | |
| ASTRAepsilon=64/2552026.03 | 15.46 | |
| Refusal Pairsepsilon=unconstrained2026.03 | 16.36 | |
| Refusal Pairsepsilon=64/2552026.03 | 17.27 | |
| Refusal Pairsepsilon=16/2552026.03 | 20 | |
| Refusal Pairsepsilon=32/2552026.03 | 22.73 | |
| Benign imageepsilon=16/2552026.03 | 24.55 | |
| Benign imageepsilon=32/2552026.03 | 24.55 | |
| Benign imageepsilon=64/2552026.03 | 24.55 | |
| Benign imageepsilon=unconstrained2026.03 | 24.55 | |
| JailGuardepsilon=64/2552026.03 | 27.27 | |
| JailGuardepsilon=unconstrained2026.03 | 28.18 | |
| ECSOepsilon=64/2552026.03 | 29.09 | |
| JailGuardepsilon=16/2552026.03 | 30 | |
| JailGuardepsilon=32/2552026.03 | 32.73 | |
| Jailbreak Templatesepsilon=16/2552026.03 | 33.64 | |
| Self-reminderepsilon=16/2552026.03 | 35.45 | |
| Self-reminderepsilon=32/2552026.03 | 36.36 | |
| ECSOepsilon=unconstrained2026.03 | 37.27 | |
| Jailbreak Templatesepsilon=32/2552026.03 | 38.15 | |
| Jailbreak Templatesepsilon=64/2552026.03 | 38.18 | |
| ECSOepsilon=16/2552026.03 | 40.91 | |
| Self-reminderepsilon=64/2552026.03 | 41.82 | |
| ECSOepsilon=32/2552026.03 | 42.73 | |
| Jailbreak Templatesepsilon=unconstrained2026.03 | 42.73 | |
| Self-reminderepsilon=unconstrained2026.03 | 43.64 | |
| w/o defenseepsilon=16/2552026.03 | 44.55 | |
| w/o defenseepsilon=32/2552026.03 | 47.27 | |
| w/o defenseepsilon=64/2552026.03 | 49.09 | |
| w/o defenseepsilon=unconstrained2026.03 | 53.64 |