Jailbreak defense and Utility evaluation on Implicit risk dataset Management
0.8Jailbreak Success Rate (JSR)DPP-MENTOR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DPP-MENTORModel=Qwen3-235B2025.11 | 0.8 | 4.754 | |
| MENTORModel=Qwen3-235B2025.11 | 1.4 | 4.794 | |
| MENTORModel=DeepSeek-R12025.11 | 1.4 | 4.576 | |
| MENTORModel=GPT-4o2025.11 | 3 | 4.394 | |
| Self-ReminderModel=Qwen3-235B2025.11 | 4.8 | 4.526 | |
| G4D-RuleTreeModel=Qwen3-235B2025.11 | 5 | 4.422 | |
| DPP-MENTORModel=GPT-4o2025.11 | 6.4 | 4.328 | |
| DPP-MENTORModel=DeepSeek-R12025.11 | 6.4 | 4.682 | |
| G4DModel=Qwen3-235B2025.11 | 8 | 4.584 | |
| G4D-RuleTreeModel=GPT-4o2025.11 | 11 | 4.354 | |
| G4D-RuleTreeModel=DeepSeek-R12025.11 | 13.4 | 4.6 | |
| G4DModel=DeepSeek-R12025.11 | 16.8 | 4.664 | |
| G4DModel=GPT-4o2025.11 | 21.2 | 4.498 | |
| Self-ReminderModel=DeepSeek-R12025.11 | 24.4 | 4.722 | |
| Self-ReminderModel=GPT-4o2025.11 | 29 | 4.454 | |
| DPPModel=Qwen3-235B2025.11 | 35.4 | 4.702 | |
| ProBModel=Qwen3-235B2025.11 | 43.8 | 4.428 | |
| RPO-MENTORModel=Qwen3-235B2025.11 | 48.2 | 4.69 | |
| RawModel=Qwen3-235B2025.11 | 51.8 | 4.774 | |
| RPOModel=Qwen3-235B2025.11 | 52 | 4.81 | |
| ProBModel=DeepSeek-R12025.11 | 59.2 | 4.52 | |
| RPO-MENTORModel=DeepSeek-R12025.11 | 61.4 | 4.792 | |
| DPPModel=DeepSeek-R12025.11 | 65.4 | 4.882 | |
| RawModel=DeepSeek-R12025.11 | 68.2 | 4.84 | |
| RPOModel=DeepSeek-R12025.11 | 69.6 | 4.838 | |
| ProBModel=GPT-4o2025.11 | 70.2 | 4.298 | |
| RPO-MENTORModel=GPT-4o2025.11 | 78 | 4.684 | |
| DPPModel=GPT-4o2025.11 | 79.4 | 4.908 | |
| RPOModel=GPT-4o2025.11 | 80.2 | 4.774 | |
| RawModel=GPT-4o2025.11 | 87.2 | 4.774 |