Multimodal Machine Unlearning on Retain Set
48.13Classification AccuracySINEPROJECT(NPO)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 48.13 | 0.591 | 6.19 | 28.04 | |
| VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 48.06 | 0.585 | 5.46 | 28.51 | |
| NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 47.84 | 0.525 | 5.91 | 27.43 | |
| PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 47.09 | 0.585 | 5.46 | 26.36 | |
| VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 46.68 | 0.582 | 5.44 | 28.49 | |
| SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 46.16 | 0.492 | 5.78 | 27.05 | |
| VanillaBase Model=LLaVA-13B, Forget Ratio=5%2025.02 | 46.11 | 0.657 | 6.38 | 27.8 | |
| VanillaForget Ratio=5%, Backbone=Idefics-2-8B2025.02 | 46.11 | 0.644 | 6.51 | 42.35 | |
| VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 46.11 | 0.632 | 6.41 | 27.83 | |
| PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 45.97 | 0.577 | 5.43 | 26.12 | |
| NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 44.81 | 0.488 | 5.65 | 26.29 | |
| MANUForget Ratio=15%, Backbone=Idefics-2-8B2025.02 | 43.95 | 0.566 | 4.98 | 41.61 | |
| Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 43.71 | 0.474 | 3.28 | 17.55 | |
| SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 43.19 | 0.653 | 6.25 | 23.66 | |
| MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 43.18 | 0.489 | 4.21 | 20.83 | |
| MANUForget Ratio=10%, Backbone=Idefics-2-8B2025.02 | 43.07 | 0.539 | 4.94 | 41.13 | |
| KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 42.96 | 0.442 | 4.42 | 22.28 | |
| NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 42.91 | 0.615 | 5.38 | 21.37 | |
| MANUBase Model=LLaVA-13B, Forget Ratio=5%2025.02 | 42.88 | 0.593 | 4.72 | 22.75 | |
| PromptingBase Model=LLaVA-13B, Forget Ratio=5%2025.02 | 42.81 | 0.622 | 5.23 | 27.66 | |
| MANUForget Ratio=5%, Backbone=Idefics-2-8B2025.02 | 42.71 | 0.538 | 4.6 | 40.01 | |
| PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 42.69 | 0.612 | 5.22 | 20.75 | |
| MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 42.64 | 0.476 | 4.08 | 19.95 | |
| MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 42.35 | 0.598 | 5.76 | 21.89 | |
| GABackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 41.91 | 0.471 | 3.36 | 19.52 | |
| Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 41.82 | 0.476 | 3.28 | 21.3 | |
| Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 41.07 | 0.508 | 4.14 | 16.9 | |
| NPOBase Model=LLaVA-13B, Forget Ratio=5%2025.02 | 40.79 | 0.565 | 4.55 | 20.23 | |
| GABackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 40.43 | 0.46 | 3.66 | 19.14 | |
| KL Minim.Base Model=LLaVA-13B, Forget Ratio=5%2025.02 | 40 | 0.571 | 4.18 | 20.07 | |
| KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 39.93 | 0.456 | 3.82 | 20.7 | |
| GABackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 39.09 | 0.495 | 2.97 | 18.96 | |
| KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 38.83 | 0.478 | 4.2 | 21.03 | |
| Grad. DiffBase Model=LLaVA-13B, Forget Ratio=5%2025.02 | 37.54 | 0.498 | 3.55 | 18.8 | |
| GABase Model=LLaVA-13B, Forget Ratio=5%2025.02 | 35.69 | 0.477 | 3.04 | 16.94 |