Safety Evaluation on WildChat unsafe prompts
99.82Not-Unsafe RateHuman-PPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Human-PPO2024.11 | 99.82 | 98.99 | 98.76 | |
| Qwen (SFT_DB)LLM=Qwen, SFT Status=SFT on AIDSAFE-generated CoTs and responses2025.05 | 96.5 | — | — | |
| RBR-PPO2024.11 | 96.03 | 95.9 | 95.19 | |
| Qwen (Base)LLM=Qwen, SFT Status=None2025.05 | 95.5 | — | — | |
| Mixtral (SFT_DB)LLM=Mixtral, SFT Status=SFT on AIDSAFE-generated CoTs and responses2025.05 | 85.95 | — | — | |
| Helpful-PPO2024.11 | 69.34 | 73.7 | 85.67 | |
| Qwen (SFT_OG)LLM=Qwen, SFT Status=SFT on original response data without CoTs2025.05 | 59.42 | — | — | |
| Mixtral (SFT_OG)LLM=Mixtral, SFT Status=SFT on original response data without CoTs2025.05 | 33.5 | — | — | |
| Mixtral (Base)LLM=Mixtral, SFT Status=None2025.05 | 31 | — | — |