Jailbreak Safety on JailbreakBench
0.3Reasoning Harmful RatioGRPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GRPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 0.3 | — | — | 0 | |
| GRPOBackbone=Qwen3-8B2025.09 | 1.7 | — | — | 0 | |
| GRPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 3 | — | — | 0.3 | |
| IPOBackbone=Qwen3-8B2025.09 | 5.2 | — | — | 0 | |
| IPOBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 5.7 | — | — | 0.3 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 6 | — | — | 0.3 | |
| STARBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 8 | — | — | 0.3 | |
| SafeKeyBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 8.7 | — | — | 0 | |
| IPOBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 11 | — | — | 0 | |
| STARBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 11.4 | — | — | 2 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 18 | — | — | 0.7 | |
| RealSafeBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 20.7 | — | — | 0 | |
| BaseBackbone=Qwen3-8B2025.09 | 24.3 | — | — | 4 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 56.1 | — | — | 25.3 | |
| SafeChainBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 56.1 | — | — | 25.3 | |
| BaseBackbone=DeepSeek-R1-Distill-Llama-8B2025.09 | 69 | — | — | 45 | |
| BaseBackbone=DeepSeek-R1-Distill-Qwen-7B2025.09 | 72.4 | — | — | 56 | |
| BackTrack2025.09 | — | 7 | 0 | — | |
| Base2025.09 | — | 69 | 45 | — | |
| GRPO2025.09 | — | 0.3 | 0 | — | |
| IPO2025.09 | — | 5.7 | 0.3 | — | |
| STAR2025.09 | — | 8 | 0.3 | — | |
| TARS2025.09 | — | 6 | 0 | — |