Safety Evaluation on HH-RedTeaming
0.036H.R.advLlama-2 Chat
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Llama-2 ChatBackbone=Llama-2-7B2024.02 | 0.036 | 0.003 | |
| Llama-2 ChatBackbone=Llama-2-13B2024.02 | 0.045 | 0 | |
| PRIORITYRULESBackbone=Llama-2-7B, Training Data=ShareGPT, Reference Signal (+Lref)=true2024.02 | 0.066 | 0.005 | |
| PRIORITYRULESBackbone=Llama-2-7B, Data Censorship=Uncensored2024.02 | 0.071 | 0.002 | |
| PRIORITYRULESBackbone=Llama-2-7B, Training Data=ShareGPT2024.02 | 0.077 | 0.003 | |
| PRIORITYRULESBackbone=Llama-2-13B, Training Data=ShareGPT2024.02 | 0.087 | 0.002 | |
| PRIORITYRULESBackbone=Llama-2-13B, Data Censorship=Uncensored, Reference Signal (+Lref)=true2024.02 | 0.087 | 0.002 | |
| PRIORITYRULESBackbone=Llama-2-13B, Data Censorship=Uncensored2024.02 | 0.09 | 0.002 | |
| PRIORITYRULESBackbone=Llama-2-7B, Data Censorship=Uncensored, Reference Signal (+Lref)=true2024.02 | 0.093 | 0.001 | |
| PRIORITYRULESBackbone=Llama-2-13B, Training Data=ShareGPT, Reference Signal (+Lref)=true2024.02 | 0.099 | 0 | |
| ShareGPTBackbone=Llama-2-7B2024.02 | 0.127 | 0.003 | |
| ShareGPT (+sys)Backbone=Llama-2-7B, System Message (+sys)=true2024.02 | 0.201 | 0.014 | |
| ShareGPTBackbone=Llama-2-13B2024.02 | 0.208 | 0.003 | |
| PRIORITYRULESBackbone=Llama-2-7B, System Message (+sys)=true, Training Data=ShareGPT2024.02 | 0.218 | 0.011 | |
| PRIORITYRULESBackbone=Llama-2-13B, Data Censorship=Uncensored, System Message (+sys)=true2024.02 | 0.22 | 0.012 | |
| PRIORITYRULESBackbone=Llama-2-13B, System Message (+sys)=true, Training Data=ShareGPT2024.02 | 0.229 | 0.013 | |
| PRIORITYRULESBackbone=Llama-2-7B, Data Censorship=Uncensored, System Message (+sys)=true2024.02 | 0.278 | 0.076 | |
| Unc. ShareGPTBackbone=Llama-2-7B, Data Censorship=Uncensored2024.02 | 0.36 | 0.009 | |
| Unc. ShareGPTBackbone=Llama-2-13B, Data Censorship=Uncensored2024.02 | 0.36 | 0.076 | |
| Unc. ShareGPT (+sys)Backbone=Llama-2-7B, Data Censorship=Uncensored, System Message (+sys)=true2024.02 | 0.422 | 0.085 | |
| ShareGPT (+sys)Backbone=Llama-2-13B, System Message (+sys)=true2024.02 | 0.454 | 0.017 | |
| Unc. ShareGPT (+sys)Backbone=Llama-2-13B, Data Censorship=Uncensored, System Message (+sys)=true2024.02 | 0.461 | 0.07 |