Classification on MLLMU-Bench (Retain Set)
67.07AccuracyGA
Evaluation Results
| Method | Links | |
|---|---|---|
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 67.07 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 67.07 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 66.87 | |
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 66.46 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 64.85 | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 64.65 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 63.03 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 55.6 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 51.62 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 51.45 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 50.8 | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 50.73 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 50.52 | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 48.96 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 48 | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 46.8 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 46.11 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 45.83 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 44.2 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 44.14 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 43.72 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 43.62 | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 43.38 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 41.6 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 41.4 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 39.61 | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 39.15 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 38.69 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 38.39 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 35.09 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 35.09 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 25.08 |