Multimodal Machine Unlearning on SAFEERASER Model Utility v1.0 (general set)
67SpecificityVanilla
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VanillaBackbone=LLaVA-v1.5-13B2025.02 | 67 | — | — | 0 | |
| PO+PDBackbone=LLaVA-v1.5-13B2025.02 | 65.3 | 62.7 | 81.7 | 27.3 | |
| POBackbone=LLaVA-v1.5-13B2025.02 | 65 | 63.2 | 82.6 | 100 | |
| VanillaBackbone=LLaVA-v1.5-7B2025.02 | 64.4 | — | — | 0 | |
| PO+PDBackbone=LLaVA-v1.5-7B2025.02 | 64.4 | 65.4 | 86.2 | 30.3 | |
| POBackbone=LLaVA-v1.5-7B2025.02 | 63.7 | 65.2 | 85.4 | 100 | |
| KL+PDBackbone=LLaVA-v1.5-13B2025.02 | 62.6 | 50.6 | 78.5 | 28.8 | |
| GD+PDBackbone=LLaVA-v1.5-13B2025.02 | 59.6 | 58.5 | 80.4 | 32.3 | |
| KL+PDBackbone=LLaVA-v1.5-7B2025.02 | 58.3 | 50.7 | 78.3 | 28.9 | |
| KLBackbone=LLaVA-v1.5-13B2025.02 | 56 | 50.4 | 77.9 | 100 | |
| GD+PDBackbone=LLaVA-v1.5-7B2025.02 | 50.7 | 61.6 | 82.8 | 28 | |
| KLBackbone=LLaVA-v1.5-7B2025.02 | 37.7 | 50.5 | 78.6 | 100 | |
| GDBackbone=LLaVA-v1.5-13B2025.02 | 31.1 | 60.5 | 81.7 | 98.6 | |
| GA+PDBackbone=LLaVA-v1.5-7B2025.02 | 28.2 | 0.5 | 2 | 28.5 | |
| GDBackbone=LLaVA-v1.5-7B2025.02 | 26.1 | 63.2 | 85 | 100 | |
| GA+PDBackbone=LLaVA-v1.5-13B2025.02 | 20.9 | 0.7 | 10.4 | 31.4 | |
| GABackbone=LLaVA-v1.5-13B2025.02 | 15.4 | 0 | 0 | 100 | |
| GABackbone=LLaVA-v1.5-7B2025.02 | 15.3 | 0 | 0 | 100 |