Visual Question Answering (VQA) on MLLMU-Bench 5% forget
0.01Contextual Refusal RateMMunlearner
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MMunlearnerBackbone=Qwen3-VL-4B, Samples=100%2026.05 | 0.01 | 0.02 | |
| NPOBackbone=LLaVA-1.5-7B, Samples=0%2026.05 | 0.04 | 0.06 | |
| GA_diffBackbone=Qwen3-VL-4B, Samples=100%2026.05 | 0.06 | 0.1 | |
| GABackbone=LLaVA-1.5-7B, Samples=0%2026.05 | 0.06 | 0.06 | |
| KL_MinBackbone=LLaVA-1.5-7B, Samples=100%2026.05 | 0.06 | 0.08 | |
| GABackbone=Qwen3-VL-4B, Samples=0%2026.05 | 0.12 | 0.14 | |
| NPOBackbone=Qwen3-VL-4B, Samples=0%2026.05 | 0.12 | 0.22 | |
| MMunlearnerBackbone=LLaVA-1.5-7B, Samples=100%2026.05 | 0.18 | 0.58 | |
| MMunlearnerBackbone=Qwen3-VL-8B, Samples=100%2026.05 | 0.2 | 0.24 | |
| KL_MinBackbone=Qwen3-VL-4B, Samples=100%2026.05 | 0.26 | 0.3 | |
| GABackbone=Qwen3-VL-8B, Samples=0%2026.05 | 0.32 | 0.34 | |
| KL_MinBackbone=Qwen3-VL-8B, Samples=100%2026.05 | 0.32 | 0.36 | |
| NPOBackbone=Qwen3-VL-8B, Samples=0%2026.05 | 0.56 | 0.58 | |
| GA_diffBackbone=LLaVA-1.5-7B, Samples=100%2026.05 | 0.62 | 0.92 | |
| GA_diffBackbone=Qwen3-VL-8B, Samples=100%2026.05 | 0.68 | 0.72 | |
| ASRUBackbone=Qwen3-VL-4B, Samples=27.30%2026.05 | 2.06 | 2.08 | |
| ASRUBackbone=LLaVA-1.5-7B, Samples=27.30%2026.05 | 2.12 | 2.06 | |
| ASRUBackbone=Qwen3-VL-8B, Samples=27.30%2026.05 | 2.98 | 3.04 |