Multimodal Machine Unlearning on UMU-Bench
40.4Forget VQA AccCVF
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CVFBackbone=Qwen2-VL-7B2026.05 | 40.4 | 70.1 | 63.3 | 60.5 | 36.1 | 45.1 | |
| MMUBackbone=Qwen2-VL-7B2026.05 | 41.8 | 46.7 | 56.6 | 57.3 | 34.5 | 39.1 | |
| MANUBackbone=Qwen2-VL-7B2026.05 | 42 | 47.4 | 56.3 | 55.4 | 33.5 | 34.6 | |
| CVFBackbone=LLaVA-1.5-7B2026.05 | 44.2 | 82 | 74.4 | 69.5 | 43.2 | 49 | |
| MMUBackbone=LLaVA-1.5-7B2026.05 | 46 | 52.2 | 54.4 | 59.2 | 40.1 | 48.3 | |
| NPOBackbone=Qwen2-VL-7B2026.05 | 46.7 | 48 | 52.3 | 56 | 34.2 | 31.7 | |
| KL_MinBackbone=LLaVA-1.5-7B2026.05 | 50 | 56 | 58.1 | 67.6 | 39.7 | 47.3 | |
| MANUBackbone=LLaVA-1.5-7B2026.05 | 50 | 56 | 53.8 | 60 | 41.1 | 45.1 | |
| GA_DiffBackbone=Qwen2-VL-7B2026.05 | 50 | 52 | 56.3 | 58.1 | 30.1 | 30.3 | |
| KL_MinBackbone=Qwen2-VL-7B2026.05 | 52 | 52 | 57 | 56.5 | 29.7 | 30.1 | |
| GABackbone=LLaVA-1.5-7B2026.05 | 53.7 | 58 | 59.1 | 66.4 | 40.5 | 48 | |
| GA_DiffBackbone=LLaVA-1.5-7B2026.05 | 54 | 60 | 56.6 | 65.1 | 40.7 | 45.7 | |
| NPOBackbone=LLaVA-1.5-7B2026.05 | 54 | 59 | 65.1 | 62.7 | 42.1 | 41 | |
| GABackbone=Qwen2-VL-7B2026.05 | 55.4 | 53.7 | 55.6 | 54.8 | 31.2 | 32.6 | |
| VanillaBackbone=Qwen2-VL-7B2026.05 | 62 | 70.1 | 71.8 | 60.5 | 48 | 45.1 | |
| VanillaBackbone=LLaVA-1.5-7B2026.05 | 76 | 82 | 76.3 | 69.5 | 44.8 | 49 |