Generation on MLLMU-Bench (Forget Set)
64.5Rouge ScoreVanilla
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 64.5 | 6.78 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 59.4 | 6.4 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 57.5 | 6.34 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 57.1 | — | |
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 56.7 | — | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 56.7 | — | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 56.5 | — | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 56.1 | — | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 55.7 | — | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 55.5 | — | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 55.2 | — | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 53.2 | — | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 52.6 | — | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 51.8 | — | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 51.7 | — | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 51.5 | — | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 50.3 | 3.48 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 50.3 | — | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 50.2 | — | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 50.2 | — | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 49.1 | 3.27 | |
| GABase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 48.5 | 3.38 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 48.4 | — | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 48.1 | 3.73 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 47.9 | — | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 45.4 | — | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 44.7 | — | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 42.1 | — | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 31.6 | — | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 31.4 | — | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 30.8 | — | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 27.4 | — | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 25.3 | — | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 25.2 | — | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 25.1 | — | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 22.1 | — | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 20 | — |