Safety Controllability on Safety Domains
100Refusal Rate (Violence)Base
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BaseBackbone=LLAMA2-7B-CHAT, Allowed Domain=None2026.05 | 100 | 100 | 100 | 100 | 100 | |
| AutoDANBackbone=LLAMA2-7B-CHAT, Allowed Domain=Hate2026.05 | 100 | 100 | 100 | 100 | 100 | |
| PALETTEBackbone=LLAMA2-7B-CHAT, Allowed Domain=Hate2026.05 | 100 | 8 | 91.8 | 98.9 | 98.8 | |
| PALETTEBackbone=LLAMA2-7B-CHAT, Allowed Domain=Sexual2026.05 | 100 | 98 | 86.7 | 12.6 | 92.8 | |
| AutoDANBackbone=LLAMA2-7B-CHAT, Allowed Domain=Disinfo2026.05 | 98.8 | 98.1 | 78.5 | 97.8 | 98.8 | |
| PALETTEBackbone=LLAMA2-7B-CHAT, Allowed Domain=Disinfo2026.05 | 98.8 | 98 | 9.2 | 94.7 | 92.9 | |
| SFTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Sexual2026.05 | 95.2 | 81.1 | 97.9 | 8.5 | 96.3 | |
| AutoDANBackbone=LLAMA2-7B-CHAT, Allowed Domain=Violence2026.05 | 93.9 | 97.1 | 63.2 | 97.8 | 79.6 | |
| AutoDANBackbone=LLAMA2-7B-CHAT, Allowed Domain=Sexual2026.05 | 93.9 | 93.4 | 54 | 98.9 | 85.1 | |
| AutoDANBackbone=LLAMA2-7B-CHAT, Allowed Domain=Illegal2026.05 | 90.3 | 95.2 | 59.1 | 96.8 | 74 | |
| PALETTEBackbone=LLAMA2-7B-CHAT, Allowed Domain=Illegal2026.05 | 86.7 | 100 | 90.8 | 98.9 | 16.5 | |
| SFTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Hate2026.05 | 85.5 | 12.3 | 87.7 | 81.1 | 96.3 | |
| SFTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Disinfo2026.05 | 75.9 | 94.3 | 14.3 | 68.4 | 87 | |
| CASTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Disinfo2026.05 | 73.4 | 75.4 | 16.3 | 61 | 81.4 | |
| CASTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Sexual2026.05 | 38.6 | 37.7 | 3.1 | 28.4 | 33.3 | |
| SFTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Illegal2026.05 | 28.9 | 94.3 | 98.9 | 50.5 | 5.6 | |
| CASTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Illegal2026.05 | 19.2 | 11.3 | 64.2 | 26.3 | 12.9 | |
| SFTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Violence2026.05 | 15.7 | 85.8 | 98.9 | 53.6 | 18.5 | |
| CASTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Hate2026.05 | 15.7 | 11.3 | 45.9 | 18.9 | 12.9 | |
| PALETTEBackbone=LLAMA2-7B-CHAT, Allowed Domain=Violence2026.05 | 12.1 | 100 | 93.9 | 95.6 | 75.9 | |
| CASTBackbone=LLAMA2-7B-CHAT, Allowed Domain=Violence2026.05 | 4.8 | 9.4 | 10.2 | 2.1 | 3.7 |