# Concept Unlearning on UnlearnCanvas object concept unlearning

Source: [Concept Unlearning on UnlearnCanvas object concept unlearning](<https://www.sota2.com/research/sota/concept-unlearning-on-unlearncanvas-object-concept-unlearning>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-01T09:14:49.220Z

Evaluation of Concept Unlearning effectiveness on the UnlearnCanvas object concept unlearning dataset, reporting Unlearning Accuracy (UA), Influence Retention Accuracy (IRA), Concept Retention Accuracy (CRA), and Average metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Concept Unlearning |
| Dataset (including any stated split) | UnlearnCanvas object concept unlearning |
| Metric | Unlearning Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Unlearning Accuracy](<https://www.sota2.com/research/sota/concept-unlearning-on-unlearncanvas-object-concept-unlearning.md?metric=Unlearning%20Accuracy>): Higher is better; unit: PERCENT.

- [Influence Retention Accuracy](<https://www.sota2.com/research/sota/concept-unlearning-on-unlearncanvas-object-concept-unlearning.md?metric=Influence%20Retention%20Accuracy>): Higher is better; unit: PERCENT.

- [Concept Retention Accuracy](<https://www.sota2.com/research/sota/concept-unlearning-on-unlearncanvas-object-concept-unlearning.md?metric=Concept%20Retention%20Accuracy>): Higher is better; unit: PERCENT.

- [Average Metric](<https://www.sota2.com/research/sota/concept-unlearning-on-unlearncanvas-object-concept-unlearning.md?metric=Average%20Metric>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Unlearning Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| SAEmnesia | 94.65 | Not recorded | 68fa7b911e209131cea892a0 |
| UCE | 94.31 | Not recorded | 68fa7b911e209131cea892a0 |
| ESD | 92.15 | Not recorded | 68fa7b911e209131cea892a0 |
| SAeUron | 87.16 | Not recorded | 68fa7b911e209131cea892a0 |
| SalUn | 86.91 | Not recorded | 68fa7b911e209131cea892a0 |
| EDiff | 86.67 | Not recorded | 68fa7b911e209131cea892a0 |
| SHS | 80.73 | Not recorded | 68fa7b911e209131cea892a0 |
| SPM | 71.25 | Not recorded | 68fa7b911e209131cea892a0 |
| CA | 46.67 | Not recorded | 68fa7b911e209131cea892a0 |
| FMN | 45.64 | Not recorded | 68fa7b911e209131cea892a0 |
| SEOT | 23.25 | Not recorded | 68fa7b911e209131cea892a0 |

### SAEmnesia

Unlearning Accuracy: 94.65. Result ID: 6a1d4d54fbc373592c16bf18.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

Recorded evaluation configuration: {"Method Family":"sparse autoencoder family"}. This record does not assert independent reproduction.

### UCE

Unlearning Accuracy: 94.31. Result ID: 6a1d4d54fbc373592c16bf10.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa755b1e209131cea67702.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### ESD

Unlearning Accuracy: 92.15. Result ID: 6a1d4d54fbc373592c16bf0e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fc61e209131cea47556.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### SAeUron

Unlearning Accuracy: 87.16. Result ID: 6a1d4d54fbc373592c16bf17.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78bc1e209131cea7a1f9.md>)

Recorded evaluation configuration: {"Method Family":"sparse autoencoder family"}. This record does not assert independent reproduction.

### SalUn

Unlearning Accuracy: 86.91. Result ID: 6a1d4d54fbc373592c16bf12.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72cd1e209131cea5888f.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### EDiff

Unlearning Accuracy: 86.67. Result ID: 6a1d4d54fbc373592c16bf15.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### SHS

Unlearning Accuracy: 80.73. Result ID: 6a1d4d54fbc373592c16bf16.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74211e209131cea5fd59.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### SPM

Unlearning Accuracy: 71.25. Result ID: 6a1d4d54fbc373592c16bf14.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72761e209131cea56871.md>)

[Implementation](<https://lyumengyao.github.io/projects/spm>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### CA

Unlearning Accuracy: 46.67. Result ID: 6a1d4d54fbc373592c16bf11.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa705c1e209131cea4a98a.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### FMN

Unlearning Accuracy: 45.64. Result ID: 6a1d4d54fbc373592c16bf0f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef41e209131cea43246.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

### SEOT

Unlearning Accuracy: 23.25. Result ID: 6a1d4d54fbc373592c16bf13.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7b911e209131cea892a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72241e209131cea54c3c.md>)

Recorded evaluation configuration: {"Method Family":"non-SAE-based"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
