Jailbreak Attack on Chao 2024
79.76ASR (DICT)FlipAttack
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FlipAttackToken=311, GPU Hour=02024.10 | 79.76 | 80.72 | |
| ReNeLLMToken=5685, GPU Hour=02024.10 | 66.18 | 56.64 | |
| ArtPromptToken=1805, GPU Hour=02024.10 | 63.52 | 5.44 | |
| DeepInceptionToken=681, GPU Hour=02024.10 | 61.55 | 23.3 | |
| CodeChameleonToken=1252, GPU Hour=02024.10 | 56.2 | 56.6 | |
| DRAToken=666, GPU Hour=02024.10 | 44.26 | 20.43 | |
| AutoDANToken=89, GPU Hour=>242024.10 | 33.39 | 37.04 | |
| TAPToken=3981, GPU Hour=02024.10 | 33.28 | 29.58 | |
| GPTFuzzerToken=336, GPU Hour=<12024.10 | 33.24 | 39.12 | |
| base64Token=91, GPU Hour=02024.10 | 31.73 | 13.63 | |
| PAIRToken=1042, GPU Hour=02024.10 | 30.65 | 20.79 | |
| PromptAttackToken=1250, GPU Hour=02024.10 | 28.85 | 2.16 | |
| SelfCipherToken=533, GPU Hour=02024.10 | 11.88 | 5.22 | |
| GCGToken=41, GPU Hour=>242024.10 | 7.5 | 7.4 | |
| COLD-AttackToken=32, GPU Hour=>242024.10 | 5.72 | 5.6 | |
| MACToken=35, GPU Hour=>242024.10 | 4.93 | 6.2 |