Class Unlearning on CIFAR-10 (Utility and MIA Metrics)
13.98Test ErrorRetrain
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| RetrainBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 13.98 | — | 100 | — | 0 | — | 48.73 | — | |
| FinetuneBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 14.53 | — | 1.31 | — | 0 | — | 74.97 | — | |
| RetrainArchitecture=ResNet2023.02 | 14.69 | 0.1 | 100 | 0 | 0 | 0 | 49.33 | 1.67 | |
| SCRUBBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 14.93 | — | 100 | — | 0.09 | — | 54.3 | — | |
| SCRUB+RBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 14.93 | — | 100 | — | 0.09 | — | 54.3 | — | |
| FinetuneArchitecture=ResNet2023.02 | 15.1 | 0.16 | 0.33 | 0.17 | 0 | 0 | 75.57 | 0.69 | |
| CF-kArchitecture=ResNet2023.02 | 15.29 | 0.02 | 0.04 | 0.04 | 0 | 0 | 75.73 | 0.34 | |
| SCRUBArchitecture=ResNet2023.02 | 15.33 | 0.06 | 100 | 0 | 0.08 | 0.01 | 52.2 | 1.71 | |
| SCRUB+RArchitecture=ResNet2023.02 | 15.33 | 0.06 | 100 | 0 | 0.08 | 0.01 | 52.2 | 1.71 | |
| OriginalBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 15.7 | — | 0 | — | 0 | — | 71.4 | — | |
| CF-kBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 15.72 | — | 0 | — | 0 | — | 72.93 | — | |
| EU-kBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 15.76 | — | 100 | — | 0.24 | — | 51.6 | — | |
| OriginalArchitecture=ResNet2023.02 | 16.33 | 0.14 | 0 | 0 | 0 | 0 | 71.1 | 0.67 | |
| Bad-TBackbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 16.98 | — | 81.93 | — | 5.84 | — | 58.07 | — | |
| NegGrad+Backbone=All-CNN, Unlearning Application=User Privacy (UP), Unlearning Scenario=Class unlearning2023.02 | 17.04 | — | 59.91 | — | 0.43 | — | 70.03 | — | |
| EU-kArchitecture=ResNet2023.02 | 17.05 | 0.07 | 97.48 | 0.28 | 0.05 | 0.01 | 54.2 | 2.27 | |
| NegGrad+Architecture=ResNet2023.02 | 17.41 | 0.09 | 61 | 1.14 | 0.44 | 0.05 | 69.57 | 1.19 | |
| Bad-TArchitecture=ResNet2023.02 | 19.56 | 1.44 | 11.34 | 1.82 | 94.67 | 6.12 | 54.33 | 0.31 |