# Machine Unlearning on ImageNet Forget set

Source: [Machine Unlearning on ImageNet Forget set](<https://www.sota2.com/research/sota/machine-unlearning-on-imagenet-forget-set>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-10T09:21:57.916Z

Evaluation of Machine Unlearning effectiveness on the specific 'Forget set' subset of ImageNet, utilizing metrics such as Au, UIS, and MIA.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Machine Unlearning |
| Dataset (including any stated split) | ImageNet Forget set |
| Metric | Au |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Au](<https://www.sota2.com/research/sota/machine-unlearning-on-imagenet-forget-set.md?metric=Au>): Higher is better; unit: PERCENT.

- [UIS](<https://www.sota2.com/research/sota/machine-unlearning-on-imagenet-forget-set.md?metric=UIS>): Higher is better; unit: SCALAR.

- [MIA](<https://www.sota2.com/research/sota/machine-unlearning-on-imagenet-forget-set.md?metric=MIA>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Au | Result date | Report paper |
| --- | --- | --- | --- |
| FISHER | 98.02 | Not recorded | 68fa773c1e209131cea71e18 |
| Original | 94.26 | Not recorded | 68fa773c1e209131cea71e18 |
| FT | 91.97 | Not recorded | 68fa773c1e209131cea71e18 |
| SCRUB | 45.82 | Not recorded | 68fa773c1e209131cea71e18 |
| Influence | 15.28 | Not recorded | 68fa773c1e209131cea71e18 |
| NegGrad | 0.41 | Not recorded | 68fa773c1e209131cea71e18 |
| GDR-GMA | 0.15 | Not recorded | 68fa773c1e209131cea71e18 |
| OrthoGrad | 0.1 | Not recorded | 68fa773c1e209131cea71e18 |
| NegGrad+ | 0.05 | Not recorded | 68fa773c1e209131cea71e18 |
| Retrain | 0 | Not recorded | 68fa773c1e209131cea71e18 |
| DUCK | 0 | Not recorded | 68fa773c1e209131cea71e18 |

### FISHER

Au: 98.02. Result ID: 69afe2ae6dbb7075b95888f6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67551e209131cea158d5.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### Original

Au: 94.26. Result ID: 69afe2ae6dbb7075b95888f1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### FT

Au: 91.97. Result ID: 69afe2ae6dbb7075b95888f3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### SCRUB

Au: 45.82. Result ID: 69afe2ae6dbb7075b95888f8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Implementation](<https://github.com/Meghdad92/SCRUB>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### Influence

Au: 15.28. Result ID: 69afe2ae6dbb7075b95888f7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68f81e209131cea1f643.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### NegGrad

Au: 0.41. Result ID: 69afe2ae6dbb7075b95888f4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cbe9.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### GDR-GMA

Au: 0.15. Result ID: 69afe2ae6dbb7075b95888fa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### OrthoGrad

Au: 0.1. Result ID: 69afe2ae6dbb7075b95888fb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### NegGrad+

Au: 0.05. Result ID: 69afe2ae6dbb7075b95888f5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71011e209131cea4e7b9.md>)

[Implementation](<https://github.com/Meghdad92/SCRUB>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### Retrain

Au: 0. Result ID: 69afe2ae6dbb7075b95888f2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72cd1e209131cea5888f.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

### DUCK

Au: 0. Result ID: 69afe2ae6dbb7075b95888f9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa773c1e209131cea71e18.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73121e209131cea5a465.md>)

Recorded evaluation configuration: {"Backbone":"ViT-b16"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.