Classification on MLLMU-Bench (test)
52.5AccuracyGA_Diff
Evaluation Results
| Method | Links | |
|---|---|---|
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 52.5 | |
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 51.67 | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 51.67 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 51.67 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 50.83 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 50.83 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 47.86 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 47.5 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 46.67 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 45.83 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 42.5 | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 41.67 | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 40.83 | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 40 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 38.33 | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 38.33 | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 38.33 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 37.5 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 37.5 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 37.5 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 36.67 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 35.83 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 35.83 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 35 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 30.83 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 29.17 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 25.83 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 25 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 25 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 23.67 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 20.83 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 3.33 |