Targeted Refusal on LLaMA2-13B-Chat (test)
100BadNetsNo Defense
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| No DefenseThreat Model=N/A2026.03 | 100 | 74.86 | 83.07 | 96.53 | 84.28 | 84.75 | |
| CROWThreat Model=Full Params2026.03 | 98.98 | 32.57 | 50.6 | 93.87 | 66.15 | 68.43 | |
| FTThreat Model=Lora Adapter2026.03 | 98.56 | 34.26 | 52.32 | 95.94 | 68.33 | 69.88 | |
| FTThreat Model=Full Params2026.03 | 98.54 | 75.63 | 81.26 | 97.24 | 86.45 | 87.82 | |
| PruningThreat Model=Lora Adapter2026.03 | 98.32 | 74.21 | 81.25 | 95.37 | 87.24 | 87.28 | |
| PruningThreat Model=Full Params2026.03 | 93.8 | 46.78 | 54.86 | 95.83 | 84.52 | 75.16 | |
| QuantizationThreat Model=Full Params2026.03 | 93.21 | 35.62 | 48.37 | 84.8 | 78.62 | 67.92 | |
| Fine-PruningThreat Model=Lora Adapter2026.03 | 90.1 | 72.54 | 83.43 | 89.52 | 78.42 | 82.8 | |
| Fine-PruningThreat Model=Full Params2026.03 | 83.65 | 34.86 | 62.78 | 82.25 | 45.33 | 61.77 | |
| BD-VAXThreat Model=Full Params2026.03 | 30.16 | 24.32 | 26.64 | 32.34 | 18.86 | 26.46 | |
| BD-VAXThreat Model=Lora Adapter2026.03 | 16.15 | 9.83 | 12.65 | 18.23 | 7.82 | 12.94 |