List your company
ResearchFormerly WizWand

Cloze Task on MLLMU-Bench (Retain Set)

24.52AccuracyNoise-T
0.06966.417312.76519.1127May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0524.52
VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0524
RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0523.15
GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0520
KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0519.13
ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0519.12
GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0519
BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0518.81
POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0518
NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0517.34
BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0516.16
GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0516.16
KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0516.16
NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0516.16
GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0515.66
POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0515.66
VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0515
RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0514.65
Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0511.63
ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0511.62
POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0511.21
NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0510.78
BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0510.57
GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0510.15
KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.059.19
RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.059
GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.055.5
Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.051.51
ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.051.26
VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.051.01