LLM Safety Evaluation on BeaverTails
9.88Ssafe ScoreLANCE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LANCEBackbone=Qwen2.5-7B2026.05 | 9.88 | 8.03 | 8.25 | |
| SelfRefineBackbone=Qwen2.5-7B2026.05 | 9.86 | 8.03 | 8.02 | |
| SysPromptBackbone=Qwen2.5-7B2026.05 | 9.79 | 8 | 7.98 | |
| VanillaBackbone=Qwen2.5-7B2026.05 | 9.74 | 8.01 | 8.03 | |
| RepEBackbone=Qwen2.5-7B2026.05 | 9.73 | 7.98 | 8.02 | |
| InstructBackbone=Qwen2.5-7B2026.05 | 9.59 | 7.58 | 7.9 | |
| InstructBackbone=Llama3-8B2026.05 | 9.55 | 3.41 | 6.71 | |
| LANCEBackbone=Llama3.1-8B2026.05 | 9.34 | 7.79 | 8.61 | |
| SelfRefineBackbone=Llama3.1-8B2026.05 | 9.27 | 6.56 | 7.67 | |
| LANCEBackbone=Llama3-8B2026.05 | 9.23 | 7.89 | 8.69 | |
| SysPromptBackbone=Llama3.1-8B2026.05 | 9.21 | 7.56 | 7.84 | |
| InstructBackbone=Llama3.1-8B2026.05 | 9.18 | 4.17 | 7 | |
| SelfRefineBackbone=Llama3-8B2026.05 | 9.03 | 6.65 | 7.86 | |
| SysPromptBackbone=Llama3-8B2026.05 | 8.4 | 7.21 | 7.74 | |
| RepEBackbone=Llama3.1-8B2026.05 | 7.66 | 7.02 | 7.63 | |
| RepEBackbone=Llama3-8B2026.05 | 5.91 | 6.45 | 7.45 | |
| VanillaBackbone=Llama3.1-8B2026.05 | 5.88 | 6.21 | 7.28 | |
| VanillaBackbone=Llama3-8B2026.05 | 4.57 | 5.59 | 7.04 |