List your company
ResearchFormerly WizWand

Cloze on MLLMU-Bench (Forget Set)

26.09Cloze AccuracyICU-T
3.48049.350215.2221.0898Feb 21, 2025May 8, 2025Jul 24, 2025Oct 8, 2025Dec 24, 2025Mar 10, 2026May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0526.09
VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.0225.81
BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0523.91
KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0523.91
RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0523.91
GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0521.74
NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0521.74
POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0521.73
GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0519.56
Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0519.56
MANUBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.0217.08
GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0512.5
KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0512.5
BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0510.87
NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0510.87
RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0510.87
VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0510.86
POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0510.86
BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0510.42
GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0510.42
POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0510.42
NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0510.42
ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0510.42
Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0510.42
VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0510.42
KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.058.7
GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.058.69
GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.058.69
RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.058.33
Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.056.52
VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.056.52
ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.054.35