# Multimodal Machine Unlearning on SAFEERASER Model Utility v1.0 (general set)

Source: [Multimodal Machine Unlearning on SAFEERASER Model Utility v1.0 (general set)](<https://www.sota2.com/research/sota/multimodal-machine-unlearning-on-safeeraser-model-utility-v1-0-general-set>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:04:39.006Z

Evaluation of Multimodal Machine Unlearning performance using the general set subset of SAFEERASER Model Utility v1.0, reporting ROUGE, GPT-Eval, Specificity, and SARR metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multimodal Machine Unlearning |
| Dataset (including any stated split) | SAFEERASER Model Utility v1.0 (general set) |
| Metric | Specificity |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Specificity](<https://www.sota2.com/research/sota/multimodal-machine-unlearning-on-safeeraser-model-utility-v1-0-general-set.md?metric=Specificity>): Higher is better; unit: PERCENT.

- [ROUGE](<https://www.sota2.com/research/sota/multimodal-machine-unlearning-on-safeeraser-model-utility-v1-0-general-set.md?metric=ROUGE>): Higher is better; unit: PERCENT.

- [GPT-Eval](<https://www.sota2.com/research/sota/multimodal-machine-unlearning-on-safeeraser-model-utility-v1-0-general-set.md?metric=GPT-Eval>): Higher is better; unit: PERCENT.

- [SARR](<https://www.sota2.com/research/sota/multimodal-machine-unlearning-on-safeeraser-model-utility-v1-0-general-set.md?metric=SARR>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Specificity | Result date | Report paper |
| --- | --- | --- | --- |
| Vanilla | 67 | Not recorded | 68fa7bbe1e209131cea8a288 |
| PO+PD | 65.3 | Not recorded | 68fa7bbe1e209131cea8a288 |
| PO | 65 | Not recorded | 68fa7bbe1e209131cea8a288 |
| Vanilla | 64.4 | Not recorded | 68fa7bbe1e209131cea8a288 |
| PO+PD | 64.4 | Not recorded | 68fa7bbe1e209131cea8a288 |
| PO | 63.7 | Not recorded | 68fa7bbe1e209131cea8a288 |
| KL+PD | 62.6 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GD+PD | 59.6 | Not recorded | 68fa7bbe1e209131cea8a288 |
| KL+PD | 58.3 | Not recorded | 68fa7bbe1e209131cea8a288 |
| KL | 56 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GD+PD | 50.7 | Not recorded | 68fa7bbe1e209131cea8a288 |
| KL | 37.7 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GD | 31.1 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GA+PD | 28.2 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GD | 26.1 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GA+PD | 20.9 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GA | 15.4 | Not recorded | 68fa7bbe1e209131cea8a288 |
| GA | 15.3 | Not recorded | 68fa7bbe1e209131cea8a288 |

### Vanilla

Specificity: 67. Result ID: 698b8a267a967eddb76f6df1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### PO+PD

Specificity: 65.3. Result ID: 698b8a267a967eddb76f6df9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### PO

Specificity: 65. Result ID: 698b8a267a967eddb76f6df8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71c71e209131cea52ea2.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### Vanilla

Specificity: 64.4. Result ID: 698b8a267a967eddb76f6de8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### PO+PD

Specificity: 64.4. Result ID: 698b8a267a967eddb76f6df0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### PO

Specificity: 63.7. Result ID: 698b8a267a967eddb76f6def.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71c71e209131cea52ea2.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### KL+PD

Specificity: 62.6. Result ID: 698b8a267a967eddb76f6df7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### GD+PD

Specificity: 59.6. Result ID: 698b8a267a967eddb76f6df5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### KL+PD

Specificity: 58.3. Result ID: 698b8a267a967eddb76f6dee.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### KL

Specificity: 56. Result ID: 698b8a267a967eddb76f6df6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c67a.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### GD+PD

Specificity: 50.7. Result ID: 698b8a267a967eddb76f6dec.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### KL

Specificity: 37.7. Result ID: 698b8a267a967eddb76f6ded.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c67a.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### GD

Specificity: 31.1. Result ID: 698b8a267a967eddb76f6df4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d3a1e209131cea38943.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### GA+PD

Specificity: 28.2. Result ID: 698b8a267a967eddb76f6dea.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### GD

Specificity: 26.1. Result ID: 698b8a267a967eddb76f6deb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d3a1e209131cea38943.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

### GA+PD

Specificity: 20.9. Result ID: 698b8a267a967eddb76f6df3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Implementation](<https://github.com/yuu250/SafeEraser>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### GA

Specificity: 15.4. Result ID: 698b8a267a967eddb76f6df2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72381e209131cea550a5.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-13B"}. This record does not assert independent reproduction.

### GA

Specificity: 15.3. Result ID: 698b8a267a967eddb76f6de9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a288.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72381e209131cea550a5.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-v1.5-7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.