# Class Unlearning on Lacuna-10 Source: [Class Unlearning on Lacuna-10]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:06:15.734Z Evaluation of Class Unlearning effectiveness on the Lacuna-10 dataset, reporting metrics such as Test error, Forget error, Retain error, and Membership Inference Attack (MIA) success rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Class Unlearning | | Dataset (including any stated split) | Lacuna-10 | | Metric | Test Error | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 27 of 27 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Test Error](): Lower is better; unit: PERCENT. - [Forget Error](): Lower is better; unit: PERCENT. - [Retain Error](): Lower is better; unit: PERCENT. - [MIA Success Rate](): Higher is better; unit: PERCENT. - [Test Error (Std Dev)](): Lower is better; unit: PERCENT. - [Retain Error (Std Dev)](): Lower is better; unit: PERCENT. - [Forget Error (Std Dev)](): Lower is better; unit: PERCENT. - [MIA (Std Dev)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Test Error | Result date | Report paper | | --- | --- | --- | --- | | Retrain | 1.67 | Not recorded | 68fa71011e209131cea4e7b9 | | Finetune | 1.67 | Not recorded | 68fa71011e209131cea4e7b9 | | Original | 1.7 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB | 1.96 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB+R | 1.96 | Not recorded | 68fa71011e209131cea4e7b9 | | NegGrad+ | 2 | Not recorded | 68fa71011e209131cea4e7b9 | | CF-k | 2.07 | Not recorded | 68fa71011e209131cea4e7b9 | | EU-k | 2.48 | Not recorded | 68fa71011e209131cea4e7b9 | | Retrain | 2.52 | Not recorded | 68fa71011e209131cea4e7b9 | | Bad-T | 2.56 | Not recorded | 68fa71011e209131cea4e7b9 | | NegGrad+ | 2.74 | Not recorded | 68fa71011e209131cea4e7b9 | | Original | 2.81 | Not recorded | 68fa71011e209131cea4e7b9 | | CF-k | 2.81 | Not recorded | 68fa71011e209131cea4e7b9 | | Retrain | 2.87 | Not recorded | 68fa71011e209131cea4e7b9 | | CF-k | 2.89 | Not recorded | 68fa71011e209131cea4e7b9 | | Finetune | 3.02 | Not recorded | 68fa71011e209131cea4e7b9 | | Finetune | 3.04 | Not recorded | 68fa71011e209131cea4e7b9 | | Original | 3.07 | Not recorded | 68fa71011e209131cea4e7b9 | | EU-k | 3.19 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB | 3.26 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB+R | 3.26 | Not recorded | 68fa71011e209131cea4e7b9 | | Fisher | 3.33 | Not recorded | 68fa71011e209131cea4e7b9 | | Bad-T | 3.37 | Not recorded | 68fa71011e209131cea4e7b9 | | Bad-T | 3.37 | Not recorded | 68fa71011e209131cea4e7b9 | | NegGrad+ | 3.41 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB | 3.69 | Not recorded | 68fa71011e209131cea4e7b9 | | EU-k | 4.15 | Not recorded | 68fa71011e209131cea4e7b9 | ### Retrain Test Error: 1.67. Result ID: 699186293a6c31484908b751. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Finetune Test Error: 1.67. Result ID: 699186293a6c31484908b753. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Original Test Error: 1.7. Result ID: 699186293a6c31484908b752. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### SCRUB Test Error: 1.96. Result ID: 699186293a6c31484908b758. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### SCRUB+R Test Error: 1.96. Result ID: 699186293a6c31484908b759. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### NegGrad+ Test Error: 2. Result ID: 699186293a6c31484908b754. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### CF-k Test Error: 2.07. Result ID: 699186293a6c31484908b755. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### EU-k Test Error: 2.48. Result ID: 699186293a6c31484908b5f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Retrain Test Error: 2.52. Result ID: 699186293a6c31484908b5ec. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Bad-T Test Error: 2.56. Result ID: 699186293a6c31484908b757. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. ### NegGrad+ Test Error: 2.74. Result ID: 699186293a6c31484908b5ef. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Original Test Error: 2.81. Result ID: 699186293a6c31484908b5ed. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### CF-k Test Error: 2.81. Result ID: 699186293a6c31484908b5f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Retrain Test Error: 2.87. Result ID: 699186293a6c31484908b698. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### CF-k Test Error: 2.89. Result ID: 699186293a6c31484908b69d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Finetune Test Error: 3.02. Result ID: 699186293a6c31484908b69a. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Finetune Test Error: 3.04. Result ID: 699186293a6c31484908b5ee. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Original Test Error: 3.07. Result ID: 699186293a6c31484908b699. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### EU-k Test Error: 3.19. Result ID: 699186293a6c31484908b69e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### SCRUB Test Error: 3.26. Result ID: 699186293a6c31484908b5f3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### SCRUB+R Test Error: 3.26. Result ID: 699186293a6c31484908b5f4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Fisher Test Error: 3.33. Result ID: 699186293a6c31484908b69b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Bad-T Test Error: 3.37. Result ID: 699186293a6c31484908b5f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Bad-T Test Error: 3.37. Result ID: 699186293a6c31484908b69f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### NegGrad+ Test Error: 3.41. Result ID: 699186293a6c31484908b69c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### SCRUB Test Error: 3.69. Result ID: 699186293a6c31484908b6a0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### EU-k Test Error: 4.15. Result ID: 699186293a6c31484908b756. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application Context":"User Privacy (UP)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.