Jailbreak Attack on AdvBench GPT-3.5-turbo 1.0 (test)
97.12Attack Success RateEquaCode
Evaluation Results
| Method | Links | |
|---|---|---|
| EquaCodeEvaluator=GPT-42025.12 | 97.12 | |
| TriageFuzzQuery Budget=252026.03 | 94 | |
| DRAAttack Type=Manual, Evaluator=GPT-42025.12 | 93.65 | |
| ReNeLLMAttack Type=Manual, Evaluator=GPT-42025.12 | 91.35 | |
| HPM2025.12 | 90.8 | |
| FlipattackAttack Type=Manual, Evaluator=GPT-42025.12 | 88.65 | |
| TriageFuzzQuery Budget=202026.03 | 88.5 | |
| PAP2025.12 | 87.8 | |
| CodeChameleonAttack Type=Manual, Evaluator=GPT-42025.12 | 84.62 | |
| AutoDANAttack Type=Automated, Evaluator=GPT-42025.12 | 81.73 | |
| TriageFuzzQuery Budget=152026.03 | 81 | |
| PAIRQuery Budget=252026.03 | 74 | |
| CoA2025.12 | 70.9 | |
| PAIRQuery Budget=202026.03 | 68 | |
| TriageFuzzQuery Budget=102026.03 | 68 | |
| TAPAttack Type=Automated, Evaluator=GPT-42025.12 | 60.54 | |
| PAIRQuery Budget=152026.03 | 60.5 | |
| PAIRAttack Type=Automated, Evaluator=GPT-42025.12 | 59.68 | |
| TAPQuery Budget=252026.03 | 58 | |
| PAIR2025.12 | 55.8 | |
| TAPQuery Budget=202026.03 | 54.5 | |
| GPTFuzzQuery Budget=252026.03 | 52 | |
| PAIRQuery Budget=102026.03 | 49.5 | |
| TAPQuery Budget=152026.03 | 48.5 | |
| GPTFuzzQuery Budget=202026.03 | 45.5 | |
| Base64Attack Type=Automated, Evaluator=GPT-42025.12 | 45 | |
| GCGAttack Type=Automated, Evaluator=GPT-42025.12 | 42.88 | |
| GPTFuzzQuery Budget=152026.03 | 42 | |
| DeepInceptionAttack Type=Manual, Evaluator=GPT-42025.12 | 41.13 | |
| TAPQuery Budget=102026.03 | 40.5 | |
| AutoDAN2025.12 | 40.2 | |
| GPTFuzzerAttack Type=Automated, Evaluator=GPT-42025.12 | 37.79 | |
| MACAttack Type=Automated, Evaluator=GPT-42025.12 | 36.15 | |
| COLD-AttackAttack Type=Automated, Evaluator=GPT-42025.12 | 34.23 | |
| GPTFuzzQuery Budget=102026.03 | 32.5 | |
| ArtPromoptAttack Type=Manual, Evaluator=GPT-42025.12 | 14.06 | |
| PromptAttackAttack Type=Manual, Evaluator=GPT-42025.12 | 13.46 | |
| SelfCipherAttack Type=Manual, Evaluator=GPT-42025.12 | 0 |