# Class Unlearning on Lacuna 10 (test) Source: [Class Unlearning on Lacuna 10 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:06:16.699Z Evaluation of Class Unlearning performance on the test split of the Lacuna 10 dataset, reporting metrics including Test error, Forget error, Retain error, and Membership Inference Attack (MIA) success rates. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Class Unlearning | | Dataset (including any stated split) | Lacuna 10 (test) | | Metric | Test Error (Mean) | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 27 of 27 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Test Error (Mean)](): Lower is better; unit: SCALAR. - [Test Error (Std Dev)](): Lower is better; unit: SCALAR. - [Forget Error (Mean)](): Lower is better; unit: SCALAR. - [Forget Error (Std Dev)](): Lower is better; unit: SCALAR. - [Retain Error (Mean)](): Lower is better; unit: SCALAR. - [Retain Error (Std Dev)](): Lower is better; unit: SCALAR. - [MIA Success Rate (Mean)](): Lower is better; unit: SCALAR. - [MIA Success Rate (Std Dev)](): Lower is better; unit: SCALAR. - [Forget Error (Mean) HIB](): Higher is better; unit: SCALAR. - [Forget Error (Std Dev) HIB](): Higher is better; unit: SCALAR. ## Recorded results | Method | Test Error (Mean) | Result date | Report paper | | --- | --- | --- | --- | | CF-k | 1.48 | Not recorded | 68fa71011e209131cea4e7b9 | | Original | 1.56 | Not recorded | 68fa71011e209131cea4e7b9 | | Retrain | 1.59 | Not recorded | 68fa71011e209131cea4e7b9 | | NegGrad+ | 1.63 | Not recorded | 68fa71011e209131cea4e7b9 | | Retrain | 1.67 | Not recorded | 68fa71011e209131cea4e7b9 | | Finetune | 1.67 | Not recorded | 68fa71011e209131cea4e7b9 | | Finetune | 1.67 | Not recorded | 68fa71011e209131cea4e7b9 | | Original | 1.7 | Not recorded | 68fa71011e209131cea4e7b9 | | EU-k | 1.74 | Not recorded | 68fa71011e209131cea4e7b9 | | Fisher | 1.78 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB | 1.96 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB+R | 1.96 | Not recorded | 68fa71011e209131cea4e7b9 | | NegGrad+ | 2 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB | 2 | Not recorded | 68fa71011e209131cea4e7b9 | | CF-k | 2.07 | Not recorded | 68fa71011e209131cea4e7b9 | | EU-k | 2.48 | Not recorded | 68fa71011e209131cea4e7b9 | | Retrain | 2.52 | Not recorded | 68fa71011e209131cea4e7b9 | | Bad-T | 2.56 | Not recorded | 68fa71011e209131cea4e7b9 | | Bad-T | 2.56 | Not recorded | 68fa71011e209131cea4e7b9 | | NegGrad+ | 2.74 | Not recorded | 68fa71011e209131cea4e7b9 | | Original | 2.81 | Not recorded | 68fa71011e209131cea4e7b9 | | CF-k | 2.81 | Not recorded | 68fa71011e209131cea4e7b9 | | Finetune | 3.04 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB | 3.26 | Not recorded | 68fa71011e209131cea4e7b9 | | SCRUB+R | 3.26 | Not recorded | 68fa71011e209131cea4e7b9 | | Bad-T | 3.37 | Not recorded | 68fa71011e209131cea4e7b9 | | EU-k | 4.15 | Not recorded | 68fa71011e209131cea4e7b9 | ### CF-k Test Error (Mean): 1.48. Result ID: 699186293a6c31484908b6cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Original Test Error (Mean): 1.56. Result ID: 699186293a6c31484908b6cb. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Retrain Test Error (Mean): 1.59. Result ID: 699186293a6c31484908b6ca. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### NegGrad+ Test Error (Mean): 1.63. Result ID: 699186293a6c31484908b6ce. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Retrain Test Error (Mean): 1.67. Result ID: 699186293a6c31484908b5fe. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Finetune Test Error (Mean): 1.67. Result ID: 699186293a6c31484908b600. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Finetune Test Error (Mean): 1.67. Result ID: 699186293a6c31484908b6cc. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Original Test Error (Mean): 1.7. Result ID: 699186293a6c31484908b5ff. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### EU-k Test Error (Mean): 1.74. Result ID: 699186293a6c31484908b6d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### Fisher Test Error (Mean): 1.78. Result ID: 699186293a6c31484908b6cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### SCRUB Test Error (Mean): 1.96. Result ID: 699186293a6c31484908b605. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### SCRUB+R Test Error (Mean): 1.96. Result ID: 699186293a6c31484908b606. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### NegGrad+ Test Error (Mean): 2. Result ID: 699186293a6c31484908b601. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### SCRUB Test Error (Mean): 2. Result ID: 699186293a6c31484908b6d2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### CF-k Test Error (Mean): 2.07. Result ID: 699186293a6c31484908b602. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### EU-k Test Error (Mean): 2.48. Result ID: 699186293a6c31484908b615. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Retrain Test Error (Mean): 2.52. Result ID: 699186293a6c31484908b610. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Bad-T Test Error (Mean): 2.56. Result ID: 699186293a6c31484908b604. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Bad-T Test Error (Mean): 2.56. Result ID: 699186293a6c31484908b6d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Application":"Removing Biases (RB)"}. This record does not assert independent reproduction. ### NegGrad+ Test Error (Mean): 2.74. Result ID: 699186293a6c31484908b613. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Original Test Error (Mean): 2.81. Result ID: 699186293a6c31484908b611. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### CF-k Test Error (Mean): 2.81. Result ID: 699186293a6c31484908b614. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Finetune Test Error (Mean): 3.04. Result ID: 699186293a6c31484908b612. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### SCRUB Test Error (Mean): 3.26. Result ID: 699186293a6c31484908b617. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### SCRUB+R Test Error (Mean): 3.26. Result ID: 699186293a6c31484908b618. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### Bad-T Test Error (Mean): 3.37. Result ID: 699186293a6c31484908b616. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. ### EU-k Test Error (Mean): 4.15. Result ID: 699186293a6c31484908b603. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Type":"Class Unlearning","Application":"User Privacy (UP)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.