Selective Unlearning on Lacuna-10 (test)
1.4Test Error (mean)Finetune
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| FinetuneArchitecture=All-CNN2023.02 | 1.4 | 0.16 | 0 | 0 | 0 | 0 | 57.33 | 3.3 | |
| FinetuneBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 1.43 | — | 0 | — | 0 | — | — | — | |
| RetrainArchitecture=All-CNN2023.02 | 1.5 | 0.08 | 0.33 | 0.47 | 0 | 0 | 52 | 2.16 | |
| OriginalBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 1.53 | — | 0 | — | 0 | — | — | — | |
| CF-kBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 1.53 | — | 0 | — | 0 | — | — | — | |
| OriginalArchitecture=All-CNN2023.02 | 1.57 | 0.24 | 0 | 0 | 0 | 0 | 59 | 2.16 | |
| CF-kArchitecture=All-CNN2023.02 | 1.57 | 0.12 | 0 | 0 | 0 | 0 | 58.33 | 2.49 | |
| RetrainBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 1.6 | — | 0.67 | — | 0 | — | — | — | |
| SCRUBArchitecture=All-CNN2023.02 | 1.67 | 0.19 | 0 | 0 | 0 | 0 | 57.67 | 0.94 | |
| SCRUB+RArchitecture=All-CNN2023.02 | 1.67 | 0.19 | 0 | 0 | 0 | 0 | 57.67 | 0.94 | |
| EU-kBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 1.83 | — | 0 | — | 0 | — | — | — | |
| FisherBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 1.87 | — | 0 | — | 0.01 | — | — | — | |
| SCRUBBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 2.07 | — | 1.67 | — | 0 | — | — | — | |
| CF-kBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 2.47 | 0.25 | 0 | 0 | 0 | 0 | 56 | 0.82 | |
| CF-kArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 2.47 | 0.25 | 0 | 0 | 0 | 0 | 56 | 0.82 | |
| RetrainBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 2.5 | 0.24 | 1.67 | 0.94 | 0 | 0 | 49.67 | 3.09 | |
| RetrainArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 2.5 | 0.24 | 1.67 | 0.94 | 0 | 0 | 49.67 | 3.09 | |
| OriginalBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 2.53 | 0.25 | 0 | 0 | 0 | 0 | 56.67 | 1.7 | |
| OriginalArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 2.53 | 0.25 | 0 | 0 | 0 | 0 | 56.67 | 1.7 | |
| EU-kBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 2.6 | 0 | 0 | 0 | 0.03 | 0 | 56 | 2.83 | |
| EU-kArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 2.6 | 0 | 0 | 0 | 0.03 | 0 | 56 | 2.83 | |
| FinetuneBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 2.67 | 0.05 | 0 | 0 | 0 | 0 | 53.67 | 0.94 | |
| FinetuneArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 2.67 | 0.05 | 0 | 0 | 0 | 0 | 53.67 | 0.94 | |
| NegGrad+Backbone=All-CNN, Application=Removing Biases (RB)2023.02 | 2.77 | — | 8.67 | — | 0.4 | — | — | — | |
| SCRUBBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 2.97 | 0.25 | 6 | 3.27 | 0 | 0 | 50.67 | 4.03 | |
| SCRUB+RBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 2.97 | 0.25 | 6 | 3.27 | 0 | 0 | 50.67 | 4.03 | |
| SCRUBArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 2.97 | 0.25 | 6 | 3.27 | 0 | 0 | 50.67 | 4.03 | |
| SCRUB+RArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 2.97 | 0.25 | 6 | 3.27 | 0 | 0 | 50.67 | 4.03 | |
| NegGrad+Architecture=All-CNN2023.02 | 3.6 | 0.14 | 14.33 | 1.25 | 0.87 | 0.07 | 51 | 1.63 | |
| EU-kArchitecture=All-CNN2023.02 | 3.9 | 1.47 | 0 | 0 | 0.76 | 0.63 | 52 | 3.56 | |
| NegGrad+Backbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 4.3 | 0.43 | 12.67 | 3.3 | 0.95 | 0.08 | 54 | 2.16 | |
| NegGrad+Architecture=ResNet, Application Type=User Privacy (UP)2023.02 | 4.3 | 0.43 | 12.67 | 3.3 | 0.95 | 0.08 | 54 | 2.16 | |
| Bad-TBackbone=All-CNN, Application=Removing Biases (RB)2023.02 | 4.9 | — | 0.67 | — | 1.34 | — | — | — | |
| Bad-TArchitecture=All-CNN2023.02 | 4.9 | 2.1 | 1.34 | 1.2 | 0.67 | 0.94 | 67.67 | 6.94 | |
| Bad-TBackbone=ResNet, Unlearning Type=Selective Unlearning, Application=User Privacy (UP)2023.02 | 7.3 | 2.2 | 3.26 | 1.83 | 0.33 | 0.47 | 67.33 | 3.4 | |
| Bad-TArchitecture=ResNet, Application Type=User Privacy (UP)2023.02 | 7.3 | 2.2 | 3.26 | 1.83 | 0.33 | 0.47 | 67.33 | 3.4 |