List your company
ResearchFormerly WizWand

Adversarial Jailbreak Attack on Guanaco 7B

100Attack Success Rate (ASR)SRA
95.195296.442697.6998.9374May 9, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SRABudget=15s2026.0510026.0599.62
BEASTBudget=30s, Venue=ICML 20242026.05100144.5778.65
SRABudget=30s2026.0510024.3999.62
SRABudget=60s2026.0510021.83100
AutoDANSource Model=Vicuna 13B, Optimization Time=15s, Attack Setting=Black-box2026.05100——
BEASTSource Model=Vicuna 13B, Optimization Time=15s, Attack Setting=Black-box2026.05100——
SRASource Model=Vicuna 13B, Optimization Time=15s, Attack Setting=Black-box2026.05100——
SRASource Model=Vicuna 13B, Optimization Time=30s, Attack Setting=Black-box2026.05100——
SRASource Model=Vicuna 13B, Optimization Time=60s, Attack Setting=Black-box2026.05100——
SRASource Model=Mistral 7B, Optimization Time=30s, Attack Setting=Black-box2026.05100——
SRASource Model=Mistral 7B, Optimization Time=60s, Attack Setting=Black-box2026.05100——
BEASTSource Model=Guanaco 7B, Optimization Time=30s, Attack Setting=White-box2026.05100——
SRASource Model=Guanaco 7B, Optimization Time=15s, Attack Setting=White-box2026.05100——
SRASource Model=Guanaco 7B, Optimization Time=30s, Attack Setting=White-box2026.05100——
SRASource Model=Guanaco 7B, Optimization Time=60s, Attack Setting=White-box2026.05100——
AutoDANBudget=15s, Venue=ICLR 20242026.0599.8157.5999.42
GCGBudget=30s, Venue=arXiv 20232026.0599.811,813.951.15
AutoDANBudget=30s, Venue=ICLR 20242026.0599.815899.42
GCGBudget=60s, Venue=arXiv 20232026.0599.814,732.070
BEASTBudget=60s, Venue=ICML 20242026.0599.81183.4466.73
BEASTSource Model=Vicuna 7B, Optimization Time=60s, Attack Setting=Black-box2026.0599.81——
SRASource Model=Vicuna 7B, Optimization Time=60s, Attack Setting=Black-box2026.0599.81——
AutoDANSource Model=Vicuna 13B, Optimization Time=30s, Attack Setting=Black-box2026.0599.81——
BEASTSource Model=Vicuna 13B, Optimization Time=60s, Attack Setting=Black-box2026.0599.81——
AutoDANSource Model=Mistral 7B, Optimization Time=15s, Attack Setting=Black-box2026.0599.81——
AutoDANSource Model=Mistral 7B, Optimization Time=30s, Attack Setting=Black-box2026.0599.81——
SRASource Model=Mistral 7B, Optimization Time=15s, Attack Setting=Black-box2026.0599.81——
GCGSource Model=Guanaco 7B, Optimization Time=30s, Attack Setting=White-box2026.0599.81——
GCGSource Model=Guanaco 7B, Optimization Time=60s, Attack Setting=White-box2026.0599.81——
AutoDANSource Model=Guanaco 7B, Optimization Time=15s, Attack Setting=White-box2026.0599.81——
AutoDANSource Model=Guanaco 7B, Optimization Time=30s, Attack Setting=White-box2026.0599.81——
BEASTSource Model=Guanaco 7B, Optimization Time=60s, Attack Setting=White-box2026.0599.81——
BEASTBudget=15s, Venue=ICML 20242026.0599.62113.9183.85
AutoDANSource Model=Vicuna 7B, Optimization Time=30s, Attack Setting=Black-box2026.0599.62——
BEASTSource Model=Vicuna 7B, Optimization Time=30s, Attack Setting=Black-box2026.0599.62——
SRASource Model=Vicuna 7B, Optimization Time=30s, Attack Setting=Black-box2026.0599.62——
BEASTSource Model=Vicuna 13B, Optimization Time=30s, Attack Setting=Black-box2026.0599.62——
AutoDANSource Model=Mistral 7B, Optimization Time=60s, Attack Setting=Black-box2026.0599.62——
BEASTSource Model=Guanaco 7B, Optimization Time=15s, Attack Setting=White-box2026.0599.62——
AutoDANBudget=60s, Venue=ICLR 20242026.0599.4258.0799.42
GCGSource Model=Vicuna 7B, Optimization Time=15s, Attack Setting=Black-box2026.0599.42——
GCGSource Model=Vicuna 7B, Optimization Time=30s, Attack Setting=Black-box2026.0599.42——
AutoDANSource Model=Vicuna 7B, Optimization Time=15s, Attack Setting=Black-box2026.0599.42——
AutoDANSource Model=Vicuna 7B, Optimization Time=60s, Attack Setting=Black-box2026.0599.42——
BEASTSource Model=Vicuna 7B, Optimization Time=15s, Attack Setting=Black-box2026.0599.42——
SRASource Model=Vicuna 7B, Optimization Time=15s, Attack Setting=Black-box2026.0599.42——
AutoDANSource Model=Vicuna 13B, Optimization Time=60s, Attack Setting=Black-box2026.0599.42——
GCGSource Model=Mistral 7B, Optimization Time=15s, Attack Setting=Black-box2026.0599.42——
GCGSource Model=Mistral 7B, Optimization Time=60s, Attack Setting=Black-box2026.0599.42——
AutoDANSource Model=Guanaco 7B, Optimization Time=60s, Attack Setting=White-box2026.0599.42——
GCGBudget=15s, Venue=arXiv 20232026.0599.23372.8331.54
GCGSource Model=Vicuna 7B, Optimization Time=60s, Attack Setting=Black-box2026.0599.23——
GCGSource Model=Guanaco 7B, Optimization Time=15s, Attack Setting=White-box2026.0599.23——
GCGSource Model=Mistral 7B, Optimization Time=30s, Attack Setting=Black-box2026.0599.04——
CleanBudget=-2026.0597.3144.3297.31
BEASTSource Model=Mistral 7B, Optimization Time=60s, Attack Setting=Black-box2026.0596.73——
BEASTSource Model=Mistral 7B, Optimization Time=30s, Attack Setting=Black-box2026.0596.35——
BEASTSource Model=Mistral 7B, Optimization Time=15s, Attack Setting=Black-box2026.0595.38——