List your company
ResearchFormerly WizWand

Multimodal Machine Unlearning on Retain Set

48.13Classification AccuracySINEPROJECT(NPO)
35.192438.551241.9145.2688Feb 21, 2025Apr 7, 2025May 23, 2025Jul 8, 2025Aug 23, 2025Oct 8, 2025Nov 23, 2025
Updated 7mo ago

Evaluation results

MethodLinks
SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1148.130.5916.1928.04
VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1148.060.5855.4628.51
NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1147.840.5255.9127.43
PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1147.090.5855.4626.36
VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1146.680.5825.4428.49
SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1146.160.4925.7827.05
VanillaBase Model=LLaVA-13B, Forget Ratio=5%2025.0246.110.6576.3827.8
VanillaForget Ratio=5%, Backbone=Idefics-2-8B2025.0246.110.6446.5142.35
VanillaBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1146.110.6326.4127.83
PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1145.970.5775.4326.12
NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1144.810.4885.6526.29
MANUForget Ratio=15%, Backbone=Idefics-2-8B2025.0243.950.5664.9841.61
Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1143.710.4743.2817.55
SINEPROJECT(NPO)Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1143.190.6536.2523.66
MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1143.180.4894.2120.83
MANUForget Ratio=10%, Backbone=Idefics-2-8B2025.0243.070.5394.9441.13
KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1142.960.4424.4222.28
NPOBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1142.910.6155.3821.37
MANUBase Model=LLaVA-13B, Forget Ratio=5%2025.0242.880.5934.7222.75
PromptingBase Model=LLaVA-13B, Forget Ratio=5%2025.0242.810.6225.2327.66
MANUForget Ratio=5%, Backbone=Idefics-2-8B2025.0242.710.5384.640.01
PromptingBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1142.690.6125.2220.75
MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1142.640.4764.0819.95
MMUnlearnerBackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1142.350.5985.7621.89
GABackbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1141.910.4713.3619.52
Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1141.820.4763.2821.3
Grad. Diff.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1141.070.5084.1416.9
NPOBase Model=LLaVA-13B, Forget Ratio=5%2025.0240.790.5654.5520.23
GABackbone=LLaVA-1.5-7B, Deletion Ratio=15%2025.1140.430.463.6619.14
KL Minim.Base Model=LLaVA-13B, Forget Ratio=5%2025.02400.5714.1820.07
KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=10%2025.1139.930.4563.8220.7
GABackbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1139.090.4952.9718.96
KL Min.Backbone=LLaVA-1.5-7B, Deletion Ratio=5%2025.1138.830.4784.221.03
Grad. DiffBase Model=LLaVA-13B, Forget Ratio=5%2025.0237.540.4983.5518.8
GABase Model=LLaVA-13B, Forget Ratio=5%2025.0235.690.4773.0416.94