Multimodal Machine Unlearning on SAFEERASER Efficacy v1.0 (forget set)
64.1ASRVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaBackbone=LLaVA-v1.5-7B2025.02 | 64.1 | 10.3 | |
| VanillaBackbone=LLaVA-v1.5-13B2025.02 | 62.3 | 13 | |
| KL+PDBackbone=LLaVA-v1.5-7B2025.02 | 5.5 | 0.1 | |
| GD+PDBackbone=LLaVA-v1.5-7B2025.02 | 2.8 | 0 | |
| GDBackbone=LLaVA-v1.5-7B2025.02 | 2.7 | 0 | |
| KLBackbone=LLaVA-v1.5-7B2025.02 | 2.7 | 0 | |
| PO+PDBackbone=LLaVA-v1.5-13B2025.02 | 2.2 | 99.5 | |
| GDBackbone=LLaVA-v1.5-13B2025.02 | 1.2 | 0 | |
| GD+PDBackbone=LLaVA-v1.5-13B2025.02 | 1.1 | 0 | |
| KLBackbone=LLaVA-v1.5-13B2025.02 | 1.1 | 0 | |
| GA+PDBackbone=LLaVA-v1.5-13B2025.02 | 0.6 | 0 | |
| KL+PDBackbone=LLaVA-v1.5-13B2025.02 | 0.3 | 0.1 | |
| PO+PDBackbone=LLaVA-v1.5-7B2025.02 | 0.2 | 100 | |
| GA+PDBackbone=LLaVA-v1.5-7B2025.02 | 0.1 | 0 | |
| POBackbone=LLaVA-v1.5-7B2025.02 | 0.1 | 100 | |
| POBackbone=LLaVA-v1.5-13B2025.02 | 0.1 | 100 | |
| GABackbone=LLaVA-v1.5-7B2025.02 | 0 | 0 | |
| GABackbone=LLaVA-v1.5-13B2025.02 | 0 | 0 |