Multimodal Machine Unlearning on SAFEERASER Generality v1.0 (test)
64.5ASRVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaBackbone=LLaVA-v1.5-7B2025.02 | 64.5 | 10.4 | |
| VanillaBackbone=LLaVA-v1.5-13B2025.02 | 62.9 | 13.7 | |
| KL+PDBackbone=LLaVA-v1.5-13B2025.02 | 3.8 | 0.2 | |
| KL+PDBackbone=LLaVA-v1.5-7B2025.02 | 2.8 | 0.3 | |
| PO+PDBackbone=LLaVA-v1.5-13B2025.02 | 2.4 | 99.1 | |
| GDBackbone=LLaVA-v1.5-7B2025.02 | 1.6 | 0 | |
| GA+PDBackbone=LLaVA-v1.5-7B2025.02 | 1.5 | 0 | |
| KLBackbone=LLaVA-v1.5-7B2025.02 | 1.2 | 0 | |
| GA+PDBackbone=LLaVA-v1.5-13B2025.02 | 0.9 | 0 | |
| GDBackbone=LLaVA-v1.5-13B2025.02 | 0.9 | 0 | |
| GD+PDBackbone=LLaVA-v1.5-13B2025.02 | 0.9 | 0.2 | |
| KLBackbone=LLaVA-v1.5-13B2025.02 | 0.8 | 0 | |
| GD+PDBackbone=LLaVA-v1.5-7B2025.02 | 0.5 | 0.1 | |
| PO+PDBackbone=LLaVA-v1.5-7B2025.02 | 0.2 | 99.7 | |
| POBackbone=LLaVA-v1.5-7B2025.02 | 0.1 | 100 | |
| POBackbone=LLaVA-v1.5-13B2025.02 | 0.1 | 99.9 | |
| GABackbone=LLaVA-v1.5-7B2025.02 | 0 | 0 | |
| GABackbone=LLaVA-v1.5-13B2025.02 | 0 | 0 |