List your company
ResearchFormerly WizWand

Multimodal Machine Unlearning Evaluation on MLLMU-Bench Real Celebrity

56.41Class AccSINEPROJECT(NPO)
39.71844.051548.38552.7185Feb 21, 2025Apr 7, 2025May 23, 2025Jul 8, 2025Aug 23, 2025Oct 8, 2025Nov 23, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1156.410.4994.6118.24
VanillaForget Ratio=5%, Backbone=Idefics-2-8B2025.0252.750.4595.7520.05
VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1151.80.4795.4717.35
VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1151.80.4795.4717.35
VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1151.80.4795.4717.35
SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1151.740.4415.5118.27
PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1151.60.4435.4317.18
PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1151.60.4714.5317.16
PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1151.60.4584.9116.84
MANUForget Ratio=15%, Backbone=Idefics-2-8B2025.0250.810.434.2219.26
SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1150.770.4925.9416.27
MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1150.280.4285.3816.45
MANUForget Ratio=5%, Backbone=Idefics-2-8B2025.0250.090.3994.1118.8
NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1149.510.455.6315.16
MANUForget Ratio=10%, Backbone=Idefics-2-8B2025.0249.310.4373.9819.1
NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1148.090.4615.0114.1
NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1147.890.4814.5316.33
MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1147.260.3944.1813.74
Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1146.520.3643.269.31
MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1145.820.3834.0512.88
KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1145.640.4183.4914.53
KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1145.580.4623.1314.9
GABackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1145.560.4143.428.66
GABackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1142.640.323.4310.53
KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1142.580.4153.2114.41
Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1141.210.4173.4511.37
Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1140.940.3913.4410.51
GABackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1140.360.3783.5410.13