List your company
ResearchFormerly WizWand

Refusal Suppression on JailbreakBench (test)

0Attack Success Rate (ASR)None (No Intervention)
-3.7621.624772.38Jun 2, 2026
Updated 5mo ago

Evaluation results

MethodLinks
None (No Intervention)Model=OSS, System Prompt=LW (Brief refusal directive)2026.060
None (No Intervention)Model=OSS, System Prompt=L2 (Complete chat-oriented prompt)2026.060
FixedSEModel=Mixtral, System Prompt=L2 (Complete chat-oriented prompt)2026.061
None (No Intervention)Model=Mixtral, System Prompt=L2 (Complete chat-oriented prompt)2026.066
FixedSEModel=Mixtral, System Prompt=LW (Brief refusal directive)2026.067
None (No Intervention)Model=Mixtral, System Prompt=LW (Brief refusal directive)2026.068
FixedAEModel=Mixtral, System Prompt=L2 (Complete chat-oriented prompt)2026.068
None (No Intervention)Model=OSS, System Prompt=N (No prompt)2026.0610
FixedSEModel=OSS, System Prompt=L2 (Complete chat-oriented prompt)2026.0613
SafetySEModel=Mixtral, System Prompt=LW (Brief refusal directive)2026.0621
FixedAEModel=Mixtral, System Prompt=LW (Brief refusal directive)2026.0624
SafetySEModel=OSS, System Prompt=L2 (Complete chat-oriented prompt)2026.0628
FixedSEModel=OSS, System Prompt=LW (Brief refusal directive)2026.0635
None (No Intervention)Model=OLMoE, System Prompt=LW (Brief refusal directive)2026.0635
FixedAEModel=OSS, System Prompt=L2 (Complete chat-oriented prompt)2026.0643
FixedSEModel=Mixtral, System Prompt=N (No prompt)2026.0645
None (No Intervention)Model=Mixtral, System Prompt=N (No prompt)2026.0646
FixedAEModel=OSS, System Prompt=LW (Brief refusal directive)2026.0647
AllAEModel=OSS, System Prompt=LW (Brief refusal directive)2026.0651
None (No Intervention)Model=OLMoE, System Prompt=L2 (Complete chat-oriented prompt)2026.0652
AllAEModel=OSS, System Prompt=L2 (Complete chat-oriented prompt)2026.0655
AllAEModel=Mixtral, System Prompt=L2 (Complete chat-oriented prompt)2026.0656
FixedAEModel=OLMoE, System Prompt=LW (Brief refusal directive)2026.0658
AllAEModel=OSS, System Prompt=N (No prompt)2026.0659
AllAEModel=Mixtral, System Prompt=LW (Brief refusal directive)2026.0659
FixedAEModel=Mixtral, System Prompt=N (No prompt)2026.0663
AllAEModel=OLMoE, System Prompt=LW (Brief refusal directive)2026.0663
None (No Intervention)Model=OLMoE, System Prompt=N (No prompt)2026.0664
FixedSEModel=OSS, System Prompt=N (No prompt)2026.0665
ActAddModel=OSS, System Prompt=LW (Brief refusal directive)2026.0666
SafetySEModel=Mixtral, System Prompt=L2 (Complete chat-oriented prompt)2026.0672
SafetySEModel=OSS, System Prompt=N (No prompt)2026.0673
SafetySEModel=OSS, System Prompt=LW (Brief refusal directive)2026.0674
SafetySEModel=OLMoE, System Prompt=L2 (Complete chat-oriented prompt)2026.0675
ActAddModel=Mixtral, System Prompt=LW (Brief refusal directive)2026.0677
ActAddModel=Mixtral, System Prompt=L2 (Complete chat-oriented prompt)2026.0677
FixedAEModel=OLMoE, System Prompt=L2 (Complete chat-oriented prompt)2026.0677
FixedAEModel=OLMoE, System Prompt=N (No prompt)2026.0679
SafetySEModel=OLMoE, System Prompt=LW (Brief refusal directive)2026.0679
FixedAEModel=OSS, System Prompt=N (No prompt)2026.0682
ActAddModel=OSS, System Prompt=L2 (Complete chat-oriented prompt)2026.0683
AllAEModel=OLMoE, System Prompt=N (No prompt)2026.0683
FixedSEModel=OLMoE, System Prompt=N (No prompt)2026.0687
AllAEModel=OLMoE, System Prompt=L2 (Complete chat-oriented prompt)2026.0687
SafetySEModel=Mixtral, System Prompt=N (No prompt)2026.0688
FixedSEModel=OLMoE, System Prompt=L2 (Complete chat-oriented prompt)2026.0688
AllAEModel=Mixtral, System Prompt=N (No prompt)2026.0690
ActAddModel=OLMoE, System Prompt=N (No prompt)2026.0690
SafetySEModel=OLMoE, System Prompt=N (No prompt)2026.0691
ActAddModel=Mixtral, System Prompt=N (No prompt)2026.0692
ActAddModel=OLMoE, System Prompt=L2 (Complete chat-oriented prompt)2026.0693
ActAddModel=OSS, System Prompt=N (No prompt)2026.0694
ActAddModel=OLMoE, System Prompt=LW (Brief refusal directive)2026.0694
FixedSEModel=OLMoE, System Prompt=LW (Brief refusal directive)2026.0694