Machine Unlearning Evaluation on WMDPbio Evaluation Suite
1Unlearn NormNPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| NPOBackbone=Llama2-7b, Runtime (min)=215.9332025.09 | 1 | 0.104 | 0.322 | 6 | |
| GABackbone=Llama2-7b, Runtime (min)=205.6332025.09 | 0.979 | 0 | 0 | 7 | |
| PRISMBackbone=Llama2-7b, Runtime (min)=40.1172025.09 | 0.963 | 0.283 | 0.521 | 1 | |
| GAGDRBackbone=Llama2-7b, Runtime (min)=122.0332025.09 | 0.944 | 0.233 | 0.469 | 4 | |
| SAM+NPOBackbone=Llama2-7b, Runtime (min)=75.5002025.09 | 0.584 | 0.337 | 0.443 | 5 | |
| NPOGDRBackbone=Llama2-7b, Runtime (min)=155.6332025.09 | 0.533 | 0.505 | 0.519 | 2 | |
| DOORBackbone=Llama2-7b, Runtime (min)=109.2302025.09 | 0.294 | 0.778 | 0.479 | 3 | |
| Task VectorBackbone=Llama2-7b, Runtime (min)=371.8672025.09 | 0 | 1 | 0 | 7 |