List your company

Safety Refusal on Jailbreak Prompts

87.2Refusal RateITI
8.99229.29649.669.904May 22, 2025

Evaluation results

MethodLinks
ITIBackbone=Llama 3.2-1B2025.0587.2
WASBackbone=Mistral 7B2025.0581.7
WASBackbone=Llama 3.1-8B2025.0578.9
ACTBackbone=Llama 3.2-1B2025.0578.5
WASBackbone=Llama 3.2-1B2025.0578
ITIBackbone=Llama 3.1-8B2025.0568.9
ACTBackbone=Llama 3.1-8B2025.0566
CASTBackbone=Mistral 7B2025.0564.3
CASTBackbone=Llama 3.1-8B2025.0563.9
CASTBackbone=Llama 3.2-1B2025.0563.2
ACTBackbone=Mistral 7B2025.0560.2
ITIBackbone=Mistral 7B2025.0559
Base ModelBackbone=Mistral 7B2025.0514
Base ModelBackbone=Llama 3.1-8B2025.0512.2
Base ModelBackbone=Llama 3.2-1B2025.0512