Knowledge Retention on Personalized (retain)
67.42Class VQA AccuracyMMunlearner
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MMunlearnerBackbone=Qwen3-VL-8B2026.05 | 67.42 | 67.67 | 63 | 63 | 24.1 | 33.7 | |
| GA_diffBackbone=Qwen3-VL-8B2026.05 | 64.79 | 65.46 | 76.9 | 78.7 | 26.9 | 37.2 | |
| KL_MinBackbone=Gemma3-12B2026.05 | 64.15 | 65.53 | 61.9 | 52.2 | 22.2 | 37.8 | |
| KL_MinBackbone=Qwen3-VL-8B2026.05 | 64.04 | 64.62 | 73.2 | 77.4 | 22.2 | 34.2 | |
| GA_diffBackbone=Gemma3-12B2026.05 | 64 | 67 | 67.3 | 74.9 | 29.5 | 40.3 | |
| MMunlearnerBackbone=Gemma3-12B2026.05 | 63.91 | 66.42 | 66.8 | 75 | 28.7 | 39.6 | |
| BeforeBackbone=Gemma3-12B2026.05 | 62.63 | 64.89 | 67.5 | 74.9 | 24.1 | 39.4 | |
| BeforeBackbone=Qwen3-VL-8B2026.05 | 61.19 | 63.07 | 74.2 | 77.6 | 22.9 | 34.3 | |
| GABackbone=Qwen3-VL-8B2026.05 | 56.53 | 59.72 | 3.1 | 68.4 | 17.2 | 30.1 | |
| MANUBackbone=Qwen3-VL-8B2026.05 | 56.37 | 63.61 | 60.4 | 74.2 | 15.6 | 27.5 | |
| MANUBackbone=Gemma3-12B2026.05 | 55.3 | 61.55 | 51.9 | 64.6 | 16.1 | 33.3 | |
| GABackbone=Gemma3-12B2026.05 | 47.82 | 62.35 | 50.9 | 75.7 | 13.7 | 36.8 | |
| NPOBackbone=Qwen3-VL-8B2026.05 | 47.72 | 43.11 | 40.9 | 46.6 | 11 | 16.6 | |
| NPOBackbone=Gemma3-12B2026.05 | 46.92 | 65.86 | 13.7 | 67.4 | 11 | 30.5 |