# Machine Unlearning on MUSE-Books RELEARN-25%

Source: [Machine Unlearning on MUSE-Books RELEARN-25%](<https://www.sota2.com/research/sota/machine-unlearning-on-muse-books-relearn-25-percent>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-31T07:20:00.813Z

Evaluation of Machine Unlearning performance on the MUSE-Books dataset under the RELEARN-25% setting, focusing on forgetting metrics (No VerbMem, No KnowMem) and utility preservation.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Machine Unlearning |
| Dataset (including any stated split) | MUSE-Books RELEARN-25% |
| Metric | Forgetting Rate (VerbMem) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Forgetting Rate (VerbMem)](<https://www.sota2.com/research/sota/machine-unlearning-on-muse-books-relearn-25-percent.md?metric=Forgetting%20Rate%20(VerbMem)>): Higher is better; unit: PERCENT.

- [Forgetting Rate (KnowMem)](<https://www.sota2.com/research/sota/machine-unlearning-on-muse-books-relearn-25-percent.md?metric=Forgetting%20Rate%20(KnowMem)>): Higher is better; unit: PERCENT.

- [Utility Preservation](<https://www.sota2.com/research/sota/machine-unlearning-on-muse-books-relearn-25-percent.md?metric=Utility%20Preservation>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Forgetting Rate (VerbMem) | Result date | Report paper |
| --- | --- | --- | --- |
| RMU-LAT | 98.425 | Not recorded | 68fa7bb21e209131cea89f6c |
| RMU | 97.029 | Not recorded | 68fa7bb21e209131cea89f6c |
| RMU-LAT | 93.87 | Not recorded | 68fa7bb21e209131cea89f6c |
| RMU | 91.875 | Not recorded | 68fa7bb21e209131cea89f6c |
| NPOGDR | 17.506 | Not recorded | 68fa7bb21e209131cea89f6c |
| SAM+NPO | 17.424 | Not recorded | 68fa7bb21e209131cea89f6c |
| PRISM | 13.313 | Not recorded | 68fa7bb21e209131cea89f6c |
| NPOGDR | 2.98 | Not recorded | 68fa7bb21e209131cea89f6c |
| SAM+NPO | 2.948 | Not recorded | 68fa7bb21e209131cea89f6c |
| RMU-LAT | 0.979 | Not recorded | 68fa7bb21e209131cea89f6c |
| RMU | 0.41 | Not recorded | 68fa7bb21e209131cea89f6c |
| PRISM | 0.082 | Not recorded | 68fa7bb21e209131cea89f6c |
| NPOGDR | 0 | Not recorded | 68fa7bb21e209131cea89f6c |
| SAM+NPO | 0 | Not recorded | 68fa7bb21e209131cea89f6c |
| PRISM | 0 | Not recorded | 68fa7bb21e209131cea89f6c |

### RMU-LAT

Forgetting Rate (VerbMem): 98.425. Result ID: 69cb759c47f34ce924b3587c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4c1e209131cea8247d.md>)

Recorded evaluation configuration: {"Relearning Steps":"100"}. This record does not assert independent reproduction.

### RMU

Forgetting Rate (VerbMem): 97.029. Result ID: 69cb759c47f34ce924b35879.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa732f1e209131cea5af82.md>)

Recorded evaluation configuration: {"Relearning Steps":"100"}. This record does not assert independent reproduction.

### RMU-LAT

Forgetting Rate (VerbMem): 93.87. Result ID: 69cb759c47f34ce924b3587b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4c1e209131cea8247d.md>)

Recorded evaluation configuration: {"Relearning Steps":"50"}. This record does not assert independent reproduction.

### RMU

Forgetting Rate (VerbMem): 91.875. Result ID: 69cb759c47f34ce924b35878.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa732f1e209131cea5af82.md>)

Recorded evaluation configuration: {"Relearning Steps":"50"}. This record does not assert independent reproduction.

### NPOGDR

Forgetting Rate (VerbMem): 17.506. Result ID: 69cb759c47f34ce924b35873.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa753a1e209131cea66964.md>)

Recorded evaluation configuration: {"Relearning Steps":"100"}. This record does not assert independent reproduction.

### SAM+NPO

Forgetting Rate (VerbMem): 17.424. Result ID: 69cb759c47f34ce924b35876.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78dc1e209131cea7adbc.md>)

Recorded evaluation configuration: {"Relearning Steps":"100"}. This record does not assert independent reproduction.

### PRISM

Forgetting Rate (VerbMem): 13.313. Result ID: 69cb759c47f34ce924b3587f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

Recorded evaluation configuration: {"Relearning Steps":"100"}. This record does not assert independent reproduction.

### NPOGDR

Forgetting Rate (VerbMem): 2.98. Result ID: 69cb759c47f34ce924b35872.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa753a1e209131cea66964.md>)

Recorded evaluation configuration: {"Relearning Steps":"50"}. This record does not assert independent reproduction.

### SAM+NPO

Forgetting Rate (VerbMem): 2.948. Result ID: 69cb759c47f34ce924b35875.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78dc1e209131cea7adbc.md>)

Recorded evaluation configuration: {"Relearning Steps":"50"}. This record does not assert independent reproduction.

### RMU-LAT

Forgetting Rate (VerbMem): 0.979. Result ID: 69cb759c47f34ce924b3587a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4c1e209131cea8247d.md>)

Recorded evaluation configuration: {"Relearning Steps":"0"}. This record does not assert independent reproduction.

### RMU

Forgetting Rate (VerbMem): 0.41. Result ID: 69cb759c47f34ce924b35877.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa732f1e209131cea5af82.md>)

Recorded evaluation configuration: {"Relearning Steps":"0"}. This record does not assert independent reproduction.

### PRISM

Forgetting Rate (VerbMem): 0.082. Result ID: 69cb759c47f34ce924b3587e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

Recorded evaluation configuration: {"Relearning Steps":"50"}. This record does not assert independent reproduction.

### NPOGDR

Forgetting Rate (VerbMem): 0. Result ID: 69cb759c47f34ce924b35871.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa753a1e209131cea66964.md>)

Recorded evaluation configuration: {"Relearning Steps":"0"}. This record does not assert independent reproduction.

### SAM+NPO

Forgetting Rate (VerbMem): 0. Result ID: 69cb759c47f34ce924b35874.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78dc1e209131cea7adbc.md>)

Recorded evaluation configuration: {"Relearning Steps":"0"}. This record does not assert independent reproduction.

### PRISM

Forgetting Rate (VerbMem): 0. Result ID: 69cb759c47f34ce924b3587d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb21e209131cea89f6c.md>)

Recorded evaluation configuration: {"Relearning Steps":"0"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
