List your company
ResearchFormerly WizWand

Open-Ended Generation on MLLMU-Bench (test)

34.5ROUGE-LBase
14.32419.56224.830.038May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0534.5
KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0533.8
NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0533.8
GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0533.6
GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0532.4
POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0532.4
RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0531.1
POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0526.2
VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0525.1
GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0524.2
KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0523.7
BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0523.7
NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0523.7
Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0523.6
RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0523.3
NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0523.1
GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0522.2
Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0521.7
ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0521.6
RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0521.3
BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0521.2
GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0520.3
ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0518.9
ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0518.7
GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0517.6
POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0517.3
VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0516.9
Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0516.2
KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0515.9
VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0515.1