Red-teaming Safety Evaluation on SC-Safety
3.33HSMeta-Llama-3.1-8B (Unaligned)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Meta-Llama-3.1-8B (Unaligned)base_model=Meta-Llama-3.1-8B2025.05 | 3.33 | 93 | 35 | |
| UnalignedBackbone Model=META-LLAMA-3.1-8B2025.05 | 3.13 | — | 30 | |
| Meta-Llama-3.1-8B (HH_RLHF-aligned)base_model=Meta-Llama-3.1-8B, alignment_dataset=HH_RLHF2025.05 | 3.11 | 84 | 28 | |
| WILDCHATBackbone Model=META-LLAMA-3.1-8B2025.05 | 2.57 | — | 19 | |
| Meta-Llama-3.1-8B (SAFE_RLHF-aligned)base_model=Meta-Llama-3.1-8B, alignment_dataset=SAFE_RLHF2025.05 | 2.44 | 78 | 22 | |
| AARTBackbone Model=META-LLAMA-3.1-8B2025.05 | 2.42 | — | 17 | |
| SAFE_RLHFBackbone Model=META-LLAMA-3.1-8B2025.05 | 2.33 | — | 15 | |
| HH_RLHFBackbone Model=META-LLAMA-3.1-8B2025.05 | 2.29 | — | 14 | |
| Meta-Llama-3.1-8B (ATTAQ-aligned)base_model=Meta-Llama-3.1-8B, alignment_dataset=ATTAQ2025.05 | 2.27 | 42 | 16 | |
| ATTAQBackbone Model=META-LLAMA-3.1-8B2025.05 | 2.27 | — | 11 | |
| Meta-Llama-3.1-8B (AART-aligned)base_model=Meta-Llama-3.1-8B, alignment_dataset=AART2025.05 | 2.18 | 58 | 13 | |
| Meta-Llama-3.1-8B (WILDCHAT-aligned)base_model=Meta-Llama-3.1-8B, alignment_dataset=WILDCHAT2025.05 | 2.13 | 44 | 11 | |
| WILDBREAKBackbone Model=META-LLAMA-3.1-8B2025.05 | 2.13 | — | 10 | |
| TRIDENT-EDGEBackbone Model=META-LLAMA-3.1-8B2025.05 | 2.07 | — | 9 | |
| Meta-Llama-3.1-8B (WILDBREAK-aligned)base_model=Meta-Llama-3.1-8B, alignment_dataset=WILDBREAK2025.05 | 1.9 | 58 | 6 | |
| Meta-Llama-3.1-8B (TRIDENT-EDGE-aligned)base_model=Meta-Llama-3.1-8B, alignment_dataset=TRIDENT-EDGE2025.05 | 1.77 | 31 | 8 |