List your company

Adversarial Attack on AdvBench 50 harmful behaviors

100ASRGPTFuzzer
4.3229.165478.84Jun 27, 2025Aug 18, 2025Oct 9, 2025Nov 30, 2025Jan 21, 2026Mar 14, 2026May 6, 2026

Evaluation results

MethodLinks
GPTFuzzerTarget Model=Vicuna-7B2025.06100—
Algorithm 1 (Greedy Random Search)Target Model=Mistral 7B2026.059018,271.92
VERATarget Model=Vicuna-7B2025.0686—
AutoDANTarget Model=Vicuna-7B2025.0682—
GCGTarget Model=Vicuna-7B2025.0672—
Algorithm 1 (Greedy Random Search)Target Model=Qwen 2.5 7B2026.056438,229.16
PAIRTarget Model=Vicuna-7B2025.0664—
Algorithm 1 (Greedy Random Search)Target Model=LLaMA 2 Chat 7B2026.056233,536.2
Algorithm 1 (Greedy Random Search)Target Model=Gemma 7B2026.055249,182.39
VERATarget Model=LLaMA2-7B-Chat2025.0616—
AutoDANTarget Model=LLaMA2-7B-Chat2025.0612—
GPTFuzzerTarget Model=LLaMA2-7B-Chat2025.0612—
GCGTarget Model=LLaMA2-7B-Chat2025.0610—
PAIRTarget Model=LLaMA2-7B-Chat2025.068—