# Class Unlearning on CIFAR-10 (Utility and MIA Metrics)

Source: [Class Unlearning on CIFAR-10 (Utility and MIA Metrics)](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:06:15.815Z

Comprehensive evaluation of Class Unlearning effectiveness on the CIFAR-10 dataset, reporting both model utility metrics (Test Error, Retention, Forgetting) and Membership Inference Attack (MIA) results.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Class Unlearning |
| Dataset (including any stated split) | CIFAR-10 |
| Metric | Test Error |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Test Error](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=Test%20Error>): Lower is better; unit: PERCENT.

- [Test Error Std Dev](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=Test%20Error%20Std%20Dev>): Lower is better; unit: PERCENT.

- [Forget Error](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=Forget%20Error>): Lower is better; unit: PERCENT.

- [Forget Error Std Dev](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=Forget%20Error%20Std%20Dev>): Lower is better; unit: PERCENT.

- [Retain Error](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=Retain%20Error>): Lower is better; unit: PERCENT.

- [Retain Error Std Dev](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=Retain%20Error%20Std%20Dev>): Lower is better; unit: PERCENT.

- [MIA](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=MIA>): Lower is better; unit: PERCENT.

- [MIA Std Dev](<https://www.sota2.com/research/sota/class-unlearning-on-cifar-10-utility-and-mia-metrics.md?metric=MIA%20Std%20Dev>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Test Error | Result date | Report paper |
| --- | --- | --- | --- |
| Retrain | 13.98 | Not recorded | 68fa71011e209131cea4e7b9 |
| Finetune | 14.53 | Not recorded | 68fa71011e209131cea4e7b9 |
| Retrain | 14.69 | Not recorded | 68fa71011e209131cea4e7b9 |
| SCRUB | 14.93 | Not recorded | 68fa71011e209131cea4e7b9 |
| SCRUB+R | 14.93 | Not recorded | 68fa71011e209131cea4e7b9 |
| Finetune | 15.1 | Not recorded | 68fa71011e209131cea4e7b9 |
| CF-k | 15.29 | Not recorded | 68fa71011e209131cea4e7b9 |
| SCRUB | 15.33 | Not recorded | 68fa71011e209131cea4e7b9 |
| SCRUB+R | 15.33 | Not recorded | 68fa71011e209131cea4e7b9 |
| Original | 15.7 | Not recorded | 68fa71011e209131cea4e7b9 |
| CF-k | 15.72 | Not recorded | 68fa71011e209131cea4e7b9 |
| EU-k | 15.76 | Not recorded | 68fa71011e209131cea4e7b9 |
| Original | 16.33 | Not recorded | 68fa71011e209131cea4e7b9 |
| Bad-T | 16.98 | Not recorded | 68fa71011e209131cea4e7b9 |
| NegGrad+ | 17.04 | Not recorded | 68fa71011e209131cea4e7b9 |
| EU-k | 17.05 | Not recorded | 68fa71011e209131cea4e7b9 |
| NegGrad+ | 17.41 | Not recorded | 68fa71011e209131cea4e7b9 |
| Bad-T | 19.56 | Not recorded | 68fa71011e209131cea4e7b9 |

### Retrain

Test Error: 13.98. Result ID: 699186293a6c31484908b722.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### Finetune

Test Error: 14.53. Result ID: 699186293a6c31484908b724.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### Retrain

Test Error: 14.69. Result ID: 699186293a6c31484908b6e7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### SCRUB

Test Error: 14.93. Result ID: 699186293a6c31484908b729.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Implementation](<https://github.com/Meghdad92/SCRUB>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### SCRUB+R

Test Error: 14.93. Result ID: 699186293a6c31484908b72a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Implementation](<https://github.com/Meghdad92/SCRUB>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### Finetune

Test Error: 15.1. Result ID: 699186293a6c31484908b6e9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### CF-k

Test Error: 15.29. Result ID: 699186293a6c31484908b6eb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67551e209131cea158d5.md>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### SCRUB

Test Error: 15.33. Result ID: 699186293a6c31484908b6ee.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Implementation](<https://github.com/Meghdad92/SCRUB>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### SCRUB+R

Test Error: 15.33. Result ID: 699186293a6c31484908b6ef.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Implementation](<https://github.com/Meghdad92/SCRUB>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### Original

Test Error: 15.7. Result ID: 699186293a6c31484908b723.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### CF-k

Test Error: 15.72. Result ID: 699186293a6c31484908b726.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67551e209131cea158d5.md>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### EU-k

Test Error: 15.76. Result ID: 699186293a6c31484908b727.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67551e209131cea158d5.md>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### Original

Test Error: 16.33. Result ID: 699186293a6c31484908b6e8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### Bad-T

Test Error: 16.98. Result ID: 699186293a6c31484908b728.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f961e209131cea46745.md>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### NegGrad+

Test Error: 17.04. Result ID: 699186293a6c31484908b725.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Backbone":"All-CNN","Unlearning Application":"User Privacy (UP)","Unlearning Scenario":"Class unlearning"}. This record does not assert independent reproduction.

### EU-k

Test Error: 17.05. Result ID: 699186293a6c31484908b6ec.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67551e209131cea158d5.md>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### NegGrad+

Test Error: 17.41. Result ID: 699186293a6c31484908b6ea.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

### Bad-T

Test Error: 19.56. Result ID: 699186293a6c31484908b6ed.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f961e209131cea46745.md>)

Recorded evaluation configuration: {"Architecture":"ResNet"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.