Multimodal Machine Unlearning on MLLMU-Bench LLaVA-1.5-7B (test 1)
65.4Forget RateMMU*
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MMU*Forget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 65.4 | 60.7 | 40.9 | |
| VanillaForget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 65 | 61.4 | 41.7 | |
| VanillaForget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 64.5 | 61.5 | 41.7 | |
| KLForget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 64 | 61.1 | 41.5 | |
| MMU*Forget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 63.7 | 62.7 | 41.3 | |
| GAForget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 60.9 | 58.9 | 39.9 | |
| VanillaForget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 60.9 | 63.3 | 41.7 | |
| NPOForget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 60.8 | 58.6 | 39.8 | |
| GDForget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 60.6 | 60.3 | 41.4 | |
| KLForget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 60.6 | 63.1 | 41.7 | |
| NPOForget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 60.4 | 59.1 | 41.2 | |
| KVWForget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 60.2 | 58.8 | 40.9 | |
| GDForget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 60.1 | 58.6 | 38.9 | |
| GAForget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 58.4 | 62.3 | 40.1 | |
| MMU*Forget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 58.3 | 63.5 | 40.8 | |
| GDForget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 58.2 | 63.3 | 41 | |
| KVWForget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 57.5 | 60.4 | 40.1 | |
| GAForget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 56.6 | 56.1 | 37.2 | |
| KLForget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 56.5 | 59.2 | 39.9 | |
| KVWForget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 56.1 | 58.7 | 39.7 | |
| NPOForget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 56 | 60.6 | 40.6 | |
| OracleForget ratio=5%, Backbone=LLaVA-1.5-7B2026.01 | 55.6 | 61.9 | 41.2 | |
| OracleForget ratio=10%, Backbone=LLaVA-1.5-7B2026.01 | 52.5 | 59.4 | 41.6 | |
| OracleForget ratio=15%, Backbone=LLaVA-1.5-7B2026.01 | 50.2 | 61 | 42.4 |