Jailbreak Safety on WildJailbreak
17.3Reasoning Harmful RatioIPO
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| IPOBackbone=Qwen3-8B2025.09 | 17.3 | — | — | 11.4 | |
| IPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 23.4 | — | — | 9.6 | |
| IPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 23.6 | — | — | 12.8 | |
| GRPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 36.3 | — | — | 33.6 | |
| STARBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 37.8 | — | — | 22.7 | |
| STARBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 43.2 | — | — | 29.7 | |
| GRPOBackbone=Qwen3-8B2025.09 | 45 | — | — | 33.6 | |
| GRPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 46 | — | — | 37.9 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 46.6 | — | — | 32.9 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 47.1 | — | — | 2 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 49.9 | — | — | 33.2 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 54.6 | — | — | 2.3 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 66.7 | — | — | 55.6 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 68.3 | — | — | 59.3 | |
| BaseBackbone=Qwen3-8B2025.09 | 80 | — | — | 64.5 | |
| BaseBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 82.3 | — | — | 74.8 | |
| BaseBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 82.4 | — | — | 73.9 | |
| BackTrack2025.09 | — | 35.7 | 20.8 | — | |
| Base2025.09 | — | 82.4 | 73.9 | — | |
| GRPO2025.09 | — | 36.3 | 33.6 | — | |
| IPO2025.09 | — | 23.4 | 9.6 | — | |
| STAR2025.09 | — | 37.8 | 22.7 | — | |
| TARS2025.09 | — | 33.2 | 29.4 | — |