List your company
ResearchFormerly WizWand

Visual Question Answering (VQA) on MLLMU-Bench 5% forget

0.01Contextual Refusal RateMMunlearner
-0.10880.69311.4952.2969May 15, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MMunlearnerBackbone=Qwen3-VL-4B, Samples=100%2026.050.010.02
NPOBackbone=LLaVA-1.5-7B, Samples=0%2026.050.040.06
GA_diffBackbone=Qwen3-VL-4B, Samples=100%2026.050.060.1
GABackbone=LLaVA-1.5-7B, Samples=0%2026.050.060.06
KL_MinBackbone=LLaVA-1.5-7B, Samples=100%2026.050.060.08
GABackbone=Qwen3-VL-4B, Samples=0%2026.050.120.14
NPOBackbone=Qwen3-VL-4B, Samples=0%2026.050.120.22
MMunlearnerBackbone=LLaVA-1.5-7B, Samples=100%2026.050.180.58
MMunlearnerBackbone=Qwen3-VL-8B, Samples=100%2026.050.20.24
KL_MinBackbone=Qwen3-VL-4B, Samples=100%2026.050.260.3
GABackbone=Qwen3-VL-8B, Samples=0%2026.050.320.34
KL_MinBackbone=Qwen3-VL-8B, Samples=100%2026.050.320.36
NPOBackbone=Qwen3-VL-8B, Samples=0%2026.050.560.58
GA_diffBackbone=LLaVA-1.5-7B, Samples=100%2026.050.620.92
GA_diffBackbone=Qwen3-VL-8B, Samples=100%2026.050.680.72
ASRUBackbone=Qwen3-VL-4B, Samples=27.30%2026.052.062.08
ASRUBackbone=LLaVA-1.5-7B, Samples=27.30%2026.052.122.06
ASRUBackbone=Qwen3-VL-8B, Samples=27.30%2026.052.983.04