List your company

Jailbreak Attack on SafeBench (Specific Metrics)

100ADU Success RateCOMET
-4235077Feb 9, 2026

Evaluation results

MethodLinks
COMETVictim Model=Gemini-2.5-Flash, Defense Setting=Vanilla2026.02100100100100100100100100
COMETVictim Model=Qwen3-VL-235B-A22B, Defense Setting=Vanilla2026.02989894100100989898
COMETVictim Model=Gemini-2.5-Flash, Defense Setting=Defended2026.029698100961009610098
COMETVictim Model=GPT-4.1, Defense Setting=Vanilla2026.02969888100989210096
COMETVictim Model=GPT-4.1, Defense Setting=Defended2026.0290928610096889893
COMETVictim Model=Qwen3-VL-235B-A22B, Defense Setting=Defended2026.029092889694869892
COMETVictim Model=GPT-4.1-mini, Defense Setting=Vanilla2026.0286100929298989294
COMETVictim Model=GPT-4.1-mini, Defense Setting=Defended2026.028496848890928889
CS-DJVictim Model=Gemini-2.5-Flash, Defense Setting=Vanilla2026.023672768472609671
CS-DJVictim Model=Gemini-2.5-Flash, Defense Setting=Defended2026.023676728068609269
CS-DJVictim Model=Qwen3-VL-235B-A22B, Defense Setting=Vanilla2026.02202218824382422
CS-DJVictim Model=GPT-4.1, Defense Setting=Vanilla2026.0267236646722440
CS-DJVictim Model=GPT-4.1, Defense Setting=Defended2026.0246832604602035
CS-DJVictim Model=GPT-4.1-mini, Defense Setting=Vanilla2026.02032242820562426
CS-DJVictim Model=GPT-4.1-mini, Defense Setting=Defended2026.0202024201
CS-DJVictim Model=Qwen3-VL-235B-A22B, Defense Setting=Defended2026.020160024321813