Jailbreak Attack on CatQA-en
1.01Harmful RateRedEval
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RedEvalVictim Model=Llama-2-7b-chat2025.02 | 1.01 | 0.18 | |
| InitialVictim Model=Llama-2-7b-chat2025.02 | 1.04 | 3.64 | |
| InitialVictim Model=GPT-3.5-turbo-01252025.02 | 1.11 | 4.18 | |
| RedEvalVictim Model=GPT-3.5-turbo-01252025.02 | 3.33 | 45.27 | |
| R2JVictim Model=Llama-2-7b-chat, Avg. Training FLOPS=48962 GFLOPS2025.02 | 4.42 | 93.27 | |
| R2JVictim Model=GPT-3.5-turbo-0125, Avg. Training FLOPS=48962 GFLOPS2025.02 | 4.7 | 97.82 |