Function Deletion on HarmfulBench
-99Delta Refusal Rate (%)CNT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CNTModel=Llama3-8B, Transfer Rate (TR)=0.00232026.03 | -99 | 91.34 | 95 | |
| EDModel=Llama3-8B2026.03 | -98.67 | 86 | 78.34 | |
| EDModel=Llama3.2-3B2026.03 | -97.33 | 83 | 73.66 | |
| CNTModel=Llama3.2-3B, Transfer Rate (TR)=0.00112026.03 | -97.33 | 76 | 67.66 | |
| RDModel=Llama3-8B2026.03 | -96.67 | 82.34 | 87.34 | |
| CNTModel=DeepSeek-V2-Lite, Transfer Rate (TR)=0.00082026.03 | -87 | 87.34 | 81.67 | |
| EDModel=DeepSeek-V2-Lite2026.03 | -84.67 | 79 | 70 | |
| CNTModel=Average, Transfer Rate (TR)=0.00142026.03 | -81.6 | 76.8 | 77.13 | |
| RDModel=Llama3.2-3B2026.03 | -81.33 | 56.34 | 49.66 | |
| EDModel=Average2026.03 | -81.2 | 71.13 | 62.73 | |
| RDModel=Average2026.03 | -77.13 | 58.8 | 60.34 | |
| ActSVD-OPModel=Mistral-Nemo-Instruct2026.03 | -73.34 | 54.67 | 66 | |
| RDModel=Mistral-Nemo-Instruct2026.03 | -73.34 | 55.67 | 66 | |
| CNTModel=Mistral-Nemo-Instruct, Transfer Rate (TR)=0.00242026.03 | -72.67 | 63.67 | 75.67 | |
| RDModel=DeepSeek-V2-Lite2026.03 | -70 | 41.67 | 35.34 | |
| EDModel=Yi-1.5-6B2026.03 | -66.33 | 62.67 | 61.34 | |
| RDModel=Yi-1.5-6B2026.03 | -64.33 | 58 | 63.34 | |
| EDModel=Mistral-Nemo-Instruct2026.03 | -59 | 45 | 30.33 | |
| ActSVD-OPModel=Yi-1.5-6B2026.03 | -57.66 | 63.67 | 65.67 | |
| ActSVD-OPModel=Llama3.2-3B2026.03 | -54 | 53 | 49.66 | |
| CNTModel=Yi-1.5-6B, Transfer Rate (TR)=0.00022026.03 | -52 | 65.67 | 65.67 | |
| ActSVD-OPModel=Average2026.03 | -51.92 | 51.42 | 54.5 | |
| ActSVD-OPModel=Llama3-8B2026.03 | -22.67 | 34.34 | 36.67 |