Refusal Detection on JailbreakBench Refusal OOD (test)
100MC RecallACS Refusal Probe
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ACS Refusal ProbeTarget Model=Llama2026.05 | 100 | 83 | |
| ACS Refusal ProbeTarget Model=Qwen2026.05 | 100 | 80 | |
| ACS Refusal ProbeTarget Model=Mistral2026.05 | 100 | 70 | |
| ACS Refusal ProbeTarget Model=Phi2026.05 | 100 | 90 | |
| ACS Refusal ProbeTarget Model=LQMP (4-fam)2026.05 | 100 | 81 | |
| ACS Refusal ProbeTarget Model=LQMPG (5-fam)2026.05 | 99 | 78 | |
| ACS Refusal ProbeTarget Model=Gemma2026.05 | 96 | 68 |