Classification on MLLMU-Bench Forget Set
63.33AccuracyBase
Evaluation Results
| Method | Links | |
|---|---|---|
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 63.33 | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 61.67 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 61.67 | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 60.83 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 60 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 60 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 54.17 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 50 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 49.17 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 49.17 | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 39.17 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 38.33 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 38.33 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 37.5 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 37.5 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 36.67 | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 36.67 | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 36.67 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 35.83 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 35 | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 34.17 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 32.5 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 31.67 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 28.33 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 28.33 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 27.5 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 25.83 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 25.33 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 24.17 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 18.83 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 0.5187 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 0.517 | |
| PromptingBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 0.4973 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 0.4915 | |
| PromptingBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 0.4841 | |
| KL MinimizationBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 0.476 | |
| NPOBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 0.474 | |
| KL MinimizationBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 0.468 | |
| PromptingBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 0.468 | |
| NPOBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 0.4561 | |
| NPOBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 0.4552 | |
| KL MinimizationBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 0.448 | |
| GABase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 0.444 | |
| GABase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 0.4385 | |
| Gradient DifferenceBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 0.436 | |
| Gradient DifferenceBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 0.4347 | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 0.4205 | |
| Gradient DifferenceBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 0.416 | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 0.4125 | |
| GABase Model=LLaVA-1.5-7B, Forget Percentage=15%2025.02 | 0.4093 | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=10%2025.02 | 0.3836 |