List your company
ResearchFormerly WizWand

MLLM Unlearning on MLLMU-Bench Retain Set 10% ratio

34.4Cloze AccuracyRMU
2.804811.007419.2127.4126May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
RMUArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0534.4120.287
GAArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0529.2950.350.485
Noise-TArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0524.0227.40.416
VGIDArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0523.8947.50.478
POArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0523.3347.10.423
Noise-TArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0522.3250.310.468
ICU-TArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0521.7644.510.492
BaseArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0521.0949.550.496
KL_MinArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0521.0949.460.512
NPOArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0518.5347.590.495
GA_DiffArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.0515.9638.530.509
VGIDArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0513.5426.290.417
NPOArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0513.0625.040.498
KL_MinArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0513.0524.240.506
BaseArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0512.9524.020.496
POArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0512.6124.330.515
GAArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0511.2726.030.339
ICU-TArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.0510.1627.90.47
RMUArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.057.0749.90.509
BaseArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.056.5750.710.523
GA_DiffArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.056.5750.30.487
POArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.056.5750.910.485
GAArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.056.0650.710.534
KL_MinArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.056.0650.710.531
NPOArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.056.0650.710.537
GA_DiffArchitecture=LLaVA-1.5-13B, Forget Ratio=10%2026.054.7934.640.496
RMUArchitecture=LLaVA-1.5-7B, Forget Ratio=10%2026.054.5551.520.46
Noise-TArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.054.2739.90.33
VGIDArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.054.27390.305
ICU-TArchitecture=Qwen2.5-VL-3B, Forget Ratio=10%2026.054.0238.290.319