Jailbreak Attack on AdvBench Strings
100EM RateADC+
Evaluation results
| Method | Links | |
|---|---|---|
| ADC+model=Vicuna-v1.5-7B, Computing Budge=0.67x, Wall-clock Time=2.0 min2024.05 | 100 | |
| ADCmodel=Vicuna-v1.5-7B, Computing Budge=0.93 x, Wall-clock Time=3.2 min2024.05 | 99 | |
| ADC+model=Zephyr-B-7B, Computing Budge=0.67x, Wall-clock Time=4.8 min2024.05 | 98.4 | |
| ADCmodel=Zephyr-B-7B, Computing Budge=0.93 x, Wall-clock Time=7.1 min2024.05 | 92.9 | |
| GCGmodel=Vicuna-v1.5-7B, Computing Budge=1x, Wall-clock Time=5.8 min2024.05 | 90.6 | |
| ADC+model=Llama2-chat-7B, Computing Budge=0.67x, Wall-clock Time=13.9 min2024.05 | 75.4 | |
| GCGmodel=Zephyr-B-7B, Computing Budge=1x, Wall-clock Time=13.7 min2024.05 | 52.4 | |
| GCGmodel=Llama2-chat-7B, Computing Budge=1x, Wall-clock Time=18.8 min2024.05 | 41.3 | |
| ADCmodel=Llama2-chat-7B, Computing Budge=0.93 x, Wall-clock Time=21.5 min2024.05 | 32.6 |