Jailbreak Detection on SafeDialBench
0.912AUCSAFEDREAM
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SAFEDREAMMethod category=Multi-turn stateful detectors (external), Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.912 | 90.1 | 6.6 | 1.2 | |
| TARSMethod category=Alignment-based methods (modify LLM weights), Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.865 | 84.7 | 5.7 | 0.55 | |
| X-BoundaryMethod category=Alignment-based methods (modify LLM weights), Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.858 | 83.9 | 9.4 | 0.37 | |
| Circuit BreakerMethod category=Alignment-based methods (modify LLM weights), Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.831 | 82.3 | 7.1 | 0.42 | |
| SelfDefendMethod category=external, stateless, Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.734 | 72.1 | 11.5 | 0.18 | |
| BingoGuardMethod category=external, stateless, Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.721 | 68 | 13.2 | 0.55 | |
| GuardReasonerMethod category=external, stateless, Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.719 | 73 | 13.7 | 0.23 | |
| R2-GuardMethod category=external, stateless, Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.691 | 69.8 | 16.9 | 0.64 | |
| WildGuardMethod category=external, stateless, Target LLM=Qwen2.5-7B-Instruct2026.04 | 0.688 | 62.5 | 17.7 | 0.89 |