List your company
ResearchFormerly WizWand

Generation on MLLMU-Bench (Forget Set)

64.5Rouge ScoreVanilla
18.2230.23542.2554.265Feb 21, 2025May 8, 2025Jul 24, 2025Oct 8, 2025Dec 24, 2025Mar 10, 2026May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.0264.56.78
VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.0259.46.4
VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.0257.56.34
BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0557.1—
BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0556.7—
GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0556.7—
GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0556.5—
NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0556.1—
KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0555.7—
NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0555.5—
KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0555.2—
RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0553.2—
RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0552.6—
GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0551.8—
BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0551.7—
POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0551.5—
MANUBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.0250.33.48
NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0550.3—
GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0550.2—
POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0550.2—
MANUBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.0249.13.27
GABase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.0248.53.38
RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0548.4—
MANUBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.0248.13.73
Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0547.9—
KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0545.4—
ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0544.7—
ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0542.1—
GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0531.6—
GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0531.4—
POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0530.8—
Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0527.4—
VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.0525.3—
Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0525.2—
ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0525.1—
VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.0522.1—
VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.0520—