Jailbreak Attack on ShadowRisk
100ASR-KWPAIR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PAIRVictim Model=Gemini-3-Flash, Search Setting=w/ agentic2026.01 | 100 | 52 | |
| FlipAttackVictim Model=DeepSeek-V3.2, Search Setting=w/ snippet2026.01 | 100 | 23 | |
| SearchAttackVictim Model=DeepSeek-V3.2, Search Setting=w/ snippet2026.01 | 100 | 15 | |
| SearchAttackVictim Model=Qwen3-32B, Search Setting=w/ snippet2026.01 | 100 | 27 | |
| SearchAttackVictim Model=GPT-4o, Search Setting=w/ snippet2026.01 | 100 | 15 | |
| SearchAttackVictim Model=Gemini-3-Flash, Search Setting=w/ snippet2026.01 | 99 | 71 | |
| SearchAttackVictim Model=Gemini-3-Flash, Search Setting=w/ agentic2026.01 | 99 | 75 | |
| FlipAttackVictim Model=DeepSeek-V3.2, Search Setting=w/ agentic2026.01 | 99 | 28 | |
| PAIRVictim Model=Qwen3-32B, Search Setting=w/ agentic2026.01 | 99 | 23 | |
| SearchAttackVictim Model=Qwen3-32B, Search Setting=w/ agentic2026.01 | 99 | 33 | |
| SearchAttackVictim Model=GPT-4o, Search Setting=w/ agentic2026.01 | 99 | 20 | |
| PAIRVictim Model=Gemini-3-Flash, Search Setting=w/ snippet2026.01 | 98 | 48 | |
| ReNeLLMVictim Model=Gemini-3-Flash, Search Setting=w/ snippet2026.01 | 98 | 0 | |
| ReNeLLMVictim Model=Gemini-3-Flash, Search Setting=w/ agentic2026.01 | 98 | 0 | |
| FlipAttackVictim Model=Gemini-3-Flash, Search Setting=w/ snippet2026.01 | 98 | 63 | |
| ReNeLLMVictim Model=DeepSeek-V3.2, Search Setting=w/ snippet2026.01 | 98 | 0 | |
| SearchAttackVictim Model=DeepSeek-V3.2, Search Setting=w/ agentic2026.01 | 98 | 34 | |
| PAIRVictim Model=Qwen3-32B, Search Setting=w/ snippet2026.01 | 98 | 17 | |
| ReNeLLMVictim Model=Qwen3-32B, Search Setting=w/ snippet2026.01 | 98 | 0 | |
| FlipAttackVictim Model=Gemini-3-Flash, Search Setting=w/ agentic2026.01 | 97 | 68 | |
| SearchAttackVictim Model=Gemini-3-Flash, Search Setting=w/o search2026.01 | 97 | 63 | |
| SearchAttackVictim Model=DeepSeek-V3.2, Search Setting=w/o search2026.01 | 97 | 0 | |
| FlipAttackVictim Model=Qwen3-32B, Search Setting=w/ agentic2026.01 | 97 | 32 | |
| PAIRVictim Model=GPT-4o, Search Setting=w/ snippet2026.01 | 97 | 8 | |
| PAIRVictim Model=GPT-4o, Search Setting=w/ agentic2026.01 | 97 | 13 | |
| ReNeLLMVictim Model=GPT-4o, Search Setting=w/ snippet2026.01 | 97 | 0 | |
| PAIRVictim Model=Gemini-3-Flash, Search Setting=w/o search2026.01 | 96 | 37 | |
| FlipAttackVictim Model=Gemini-3-Flash, Search Setting=w/o search2026.01 | 96 | 52 | |
| ReNeLLMVictim Model=Qwen3-32B, Search Setting=w/ agentic2026.01 | 96 | 0 | |
| FlipAttackVictim Model=Qwen3-32B, Search Setting=w/ snippet2026.01 | 96 | 21 | |
| ReNeLLMVictim Model=Gemini-3-Flash, Search Setting=w/o search2026.01 | 95 | 0 | |
| ReNeLLMVictim Model=DeepSeek-V3.2, Search Setting=w/ agentic2026.01 | 95 | 0 | |
| FlipAttackVictim Model=DeepSeek-V3.2, Search Setting=w/o search2026.01 | 95 | 1 | |
| ReNeLLMVictim Model=GPT-4o, Search Setting=w/ agentic2026.01 | 95 | 0 | |
| SearchAttackVictim Model=Qwen3-32B, Search Setting=w/o search2026.01 | 94 | 14 | |
| PAIRVictim Model=DeepSeek-V3.2, Search Setting=w/ snippet2026.01 | 93 | 9 | |
| FlipAttackVictim Model=GPT-4o, Search Setting=w/ snippet2026.01 | 93 | 12 | |
| FlipAttackVictim Model=GPT-4o, Search Setting=w/ agentic2026.01 | 93 | 17 | |
| SearchAttackVictim Model=GPT-4o, Search Setting=w/o search2026.01 | 93 | 8 | |
| ReNeLLMVictim Model=GPT-4o, Search Setting=w/o search2026.01 | 91 | 0 | |
| PAIRVictim Model=GPT-4o, Search Setting=w/o search2026.01 | 88 | 2 | |
| PAIRVictim Model=Qwen3-32B, Search Setting=w/o search2026.01 | 87 | 8 | |
| FlipAttackVictim Model=Qwen3-32B, Search Setting=w/o search2026.01 | 87 | 12 | |
| PAIRVictim Model=DeepSeek-V3.2, Search Setting=w/ agentic2026.01 | 84 | 14 | |
| ReNeLLMVictim Model=Qwen3-32B, Search Setting=w/o search2026.01 | 83 | 0 | |
| PAIRVictim Model=DeepSeek-V3.2, Search Setting=w/o search2026.01 | 76 | 0 | |
| ReNeLLMVictim Model=DeepSeek-V3.2, Search Setting=w/o search2026.01 | 74 | 0 | |
| FlipAttackVictim Model=GPT-4o, Search Setting=w/o search2026.01 | 69 | 5 |