Multimodal Machine Unlearning Evaluation on MLLMU-Bench Real Celebrity
56.41Class AccSINEPROJECT(NPO)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 56.41 | 0.499 | 4.61 | 18.24 | |
| VanillaForget Ratio=5%, Backbone=Idefics-2-8B2025.02 | 52.75 | 0.459 | 5.75 | 20.05 | |
| VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 51.8 | 0.479 | 5.47 | 17.35 | |
| VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 51.8 | 0.479 | 5.47 | 17.35 | |
| VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 51.8 | 0.479 | 5.47 | 17.35 | |
| SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 51.74 | 0.441 | 5.51 | 18.27 | |
| PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 51.6 | 0.443 | 5.43 | 17.18 | |
| PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 51.6 | 0.471 | 4.53 | 17.16 | |
| PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 51.6 | 0.458 | 4.91 | 16.84 | |
| MANUForget Ratio=15%, Backbone=Idefics-2-8B2025.02 | 50.81 | 0.43 | 4.22 | 19.26 | |
| SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 50.77 | 0.492 | 5.94 | 16.27 | |
| MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 50.28 | 0.428 | 5.38 | 16.45 | |
| MANUForget Ratio=5%, Backbone=Idefics-2-8B2025.02 | 50.09 | 0.399 | 4.11 | 18.8 | |
| NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 49.51 | 0.45 | 5.63 | 15.16 | |
| MANUForget Ratio=10%, Backbone=Idefics-2-8B2025.02 | 49.31 | 0.437 | 3.98 | 19.1 | |
| NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 48.09 | 0.461 | 5.01 | 14.1 | |
| NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 47.89 | 0.481 | 4.53 | 16.33 | |
| MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 47.26 | 0.394 | 4.18 | 13.74 | |
| Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 46.52 | 0.364 | 3.26 | 9.31 | |
| MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 45.82 | 0.383 | 4.05 | 12.88 | |
| KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 45.64 | 0.418 | 3.49 | 14.53 | |
| KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 45.58 | 0.462 | 3.13 | 14.9 | |
| GABackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.11 | 45.56 | 0.414 | 3.42 | 8.66 | |
| GABackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 42.64 | 0.32 | 3.43 | 10.53 | |
| KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 42.58 | 0.415 | 3.21 | 14.41 | |
| Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 41.21 | 0.417 | 3.45 | 11.37 | |
| Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.11 | 40.94 | 0.391 | 3.44 | 10.51 | |
| GABackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.11 | 40.36 | 0.378 | 3.54 | 10.13 |