Safety and Utility Evaluation on Management subset
0.872JSR ScoreVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaTarget Model=GPT-4o2025.11 | 0.872 | 4.774 | |
| RPOTarget Model=GPT-4o2025.11 | 0.802 | 4.774 | |
| DPPTarget Model=GPT-4o2025.11 | 0.794 | 4.908 | |
| RPO-MENTORTarget Model=GPT-4o2025.11 | 0.78 | 4.684 | |
| ProBTarget Model=GPT-4o2025.11 | 0.702 | 4.298 | |
| RPOTarget Model=DeepSeek-R12025.11 | 0.696 | 4.838 | |
| VanillaTarget Model=Average2025.11 | 0.691 | 4.796 | |
| VanillaTarget Model=DeepSeek-R12025.11 | 0.682 | 4.84 | |
| RPOTarget Model=Average2025.11 | 0.673 | 4.807 | |
| DPPTarget Model=DeepSeek-R12025.11 | 0.654 | 4.882 | |
| RPO-MENTORTarget Model=Average2025.11 | 0.625 | 4.722 | |
| RPO-MENTORTarget Model=DeepSeek-R12025.11 | 0.614 | 4.792 | |
| DPPTarget Model=Average2025.11 | 0.601 | 4.831 | |
| ProBTarget Model=DeepSeek-R12025.11 | 0.592 | 4.52 | |
| ProBTarget Model=Average2025.11 | 0.577 | 4.415 | |
| RPOTarget Model=Qwen3-235B2025.11 | 0.52 | 4.81 | |
| VanillaTarget Model=Qwen3-235B2025.11 | 0.518 | 4.774 | |
| RPO-MENTORTarget Model=Qwen3-235B2025.11 | 0.482 | 4.69 | |
| ProBTarget Model=Qwen3-235B2025.11 | 0.438 | 4.428 | |
| DPPTarget Model=Qwen3-235B2025.11 | 0.354 | 4.702 | |
| RePDTarget Model=DeepSeek-R12025.11 | 0.328 | 4.523 | |
| Self-ReminderTarget Model=GPT-4o2025.11 | 0.29 | 4.454 | |
| RePDTarget Model=GPT-4o2025.11 | 0.262 | 1.74 | |
| Self-ReminderTarget Model=DeepSeek-R12025.11 | 0.244 | 4.722 | |
| G4DTarget Model=GPT-4o2025.11 | 0.212 | 4.498 | |
| RePDTarget Model=Average2025.11 | 0.198 | 2.78 | |
| Self-ReminderTarget Model=Average2025.11 | 0.194 | 4.567 | |
| G4DTarget Model=DeepSeek-R12025.11 | 0.168 | 4.664 | |
| G4DTarget Model=Average2025.11 | 0.153 | 4.582 | |
| G4D-RuleTreeTarget Model=DeepSeek-R12025.11 | 0.134 | 4.6 | |
| G4D-RuleTreeTarget Model=GPT-4o2025.11 | 0.11 | 4.354 | |
| G4D-RuleTreeTarget Model=Average2025.11 | 0.098 | 4.459 | |
| G4DTarget Model=Qwen3-235B2025.11 | 0.08 | 4.584 | |
| DPP-MENTORTarget Model=GPT-4o2025.11 | 0.064 | 4.328 | |
| DPP-MENTORTarget Model=DeepSeek-R12025.11 | 0.064 | 4.682 | |
| G4D-RuleTreeTarget Model=Qwen3-235B2025.11 | 0.05 | 4.422 | |
| Self-ReminderTarget Model=Qwen3-235B2025.11 | 0.048 | 4.526 | |
| DPP-MENTORTarget Model=Average2025.11 | 0.045 | 4.588 | |
| MENTORTarget Model=GPT-4o2025.11 | 0.03 | 4.394 | |
| MENTORTarget Model=Average2025.11 | 0.019 | 4.588 | |
| MENTORTarget Model=Qwen3-235B2025.11 | 0.014 | 4.794 | |
| MENTORTarget Model=DeepSeek-R12025.11 | 0.014 | 4.576 | |
| DPP-MENTORTarget Model=Qwen3-235B2025.11 | 0.008 | 4.754 | |
| RePDTarget Model=Qwen3-235B2025.11 | 0.005 | 2.077 |