List your company
ResearchFormerly WizWand

Open-Ended Generation on MLLMU-Bench (Retain Set)

53.1ROUGE-LPO
29.28435.46741.6547.833May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0553.1
KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0552.9
NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0552.6
KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0552.5
GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0552.4
BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0552.3
Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0550.9
GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0550.6
NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0550.5
GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0550.5
BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0549.6
BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0549.3
NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0549.3
RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0549.3
POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0549
GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0548.1
RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0548.1
RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0547.4
ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0545.7
VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0544.1
VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0543.8
Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0541.6
KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0541.4
ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0541.3
Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0534.4
GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0532.9
ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0532.3
GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0531.3
POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0530.4
VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0530.2