Knowledge Forgetting on Personalized Forget-Set (forget)
70.31Accuracy (Class VQA)MMunlearner
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MMunlearnerBackbone=Gemma3-12B2026.05 | 70.31 | 65.96 | 58 | 55.3 | 14.9 | 18.7 | |
| KL_MinBackbone=Gemma3-12B2026.05 | 69.23 | 59.85 | 51.6 | 24.6 | 11.7 | 15.9 | |
| MMunlearnerBackbone=Qwen3-VL-8B2026.05 | 67.85 | 66.89 | 19.7 | 25.4 | 10.8 | 13.6 | |
| BeforeBackbone=Gemma3-12B2026.05 | 66.25 | 59.25 | 57.4 | 63.7 | 13.4 | 18.6 | |
| GA_diffBackbone=Gemma3-12B2026.05 | 66.19 | 61.1 | 54.3 | 59.6 | 14.9 | 17.4 | |
| BeforeBackbone=Qwen3-VL-8B2026.05 | 62.48 | 57.45 | 62.5 | 68.8 | 12.9 | 15.8 | |
| MANUBackbone=Gemma3-12B2026.05 | 61.07 | 55.37 | 45.1 | 54 | 10.1 | 15.2 | |
| GA_diffBackbone=Qwen3-VL-8B2026.05 | 58.86 | 52.72 | 68.2 | 67.6 | 13.1 | 15.6 | |
| MANUBackbone=Qwen3-VL-8B2026.05 | 56.3 | 57.87 | 55.6 | 68.4 | 11.1 | 14.4 | |
| KL_MinBackbone=Qwen3-VL-8B2026.05 | 56.01 | 48.02 | 55.5 | 63 | 10.8 | 14.5 | |
| GABackbone=Qwen3-VL-8B2026.05 | 55.98 | 50.86 | — | 56 | 10 | 13.7 | |
| NPOBackbone=Qwen3-VL-8B2026.05 | 40.82 | 37.56 | 31.2 | 38.3 | 6.7 | 7.3 | |
| NPOBackbone=Gemma3-12B2026.05 | 37.04 | 63.47 | 13 | 56.7 | 4.9 | 13.4 | |
| GABackbone=Gemma3-12B2026.05 | 32.44 | 52.82 | 42 | 65.7 | 9.8 | 16.5 |