Visual Question Answering Unlearning on MLLMU-Bench 15% forget ratio (test)
49.33Classification Forget QualityMMunlearner
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| MMunlearnersamples (Dr)=100%, Backbone=Qwen3-VL-8B-Instruct2026.05 | 49.33 | 59.2 | 55.1 | 33.6 | 0.093 | 0.12 | 51.42 | 76.76 | 53.8 | 37.9 | |
| NPOsamples (Dr)=0.00%, Backbone=Qwen3-VL-8B-Instruct2026.05 | 45.6 | 48 | 40.6 | 27 | 0.03 | 0.05 | 47.41 | 76.76 | 41.4 | 35.5 | |
| Vanillasamples (Dr)=-, Backbone=Qwen3-VL-8B-Instruct2026.05 | 45.33 | 54.13 | 55.5 | 32.2 | — | — | 49.1 | 78.59 | 57.2 | 43.4 | |
| GAsamples (Dr)=0.00%, Backbone=Qwen3-VL-8B-Instruct2026.05 | 45.06 | 52.8 | 54.9 | 33.8 | 0.17 | 0.19 | 47.97 | 74.15 | 54.1 | 36.4 | |
| GA_diffsamples (Dr)=100%, Backbone=Qwen3-VL-8B-Instruct2026.05 | 44.8 | 53.6 | 54.9 | 33.5 | 0.17 | 0.17 | 46.32 | 73.5 | 53.4 | 37.9 | |
| KL_Minsamples (Dr)=100%, Backbone=Qwen3-VL-8B-Instruct2026.05 | 41.07 | 49.07 | 53.7 | 32.1 | 0.26 | 0.27 | 44.72 | 76.11 | 52.3 | 37.1 | |
| ASRUsamples (Dr)=30.55%, Backbone=Qwen3-VL-8B-Instruct2026.05 | 30.67 | 41.33 | 33.9 | 25.3 | 2.77 | 2.77 | 57.97 | 77.02 | 54.8 | 38 |