Lifelong Unlearning on MLUBench
100A-UA ForgetLUMoE
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LUMoEBackbone=LLaVA-7B2026.06 | 100 | — | — | — | — | — | — | — | — | — | — | 93 | 100 | 93 | 100 | 93 | 100 | 93 | 95 | 88 | 95 | 88 | 95 | 88 | 99 | 94 | 99 | 94 | 96 | 91 | |
| LUMoEBackbone=LLaVA-13B2026.06 | 100 | — | — | — | — | — | — | — | — | — | — | 95 | 100 | 95 | 100 | 95 | 100 | 95 | 95 | 90 | 95 | 90 | 95 | 90 | 100 | 92 | 100 | 92 | 98 | 94 | |
| NPOBackbone=LLaVA-13B2026.06 | 51 | — | — | — | — | — | — | — | — | — | — | 8.4 | 3 | 0 | 0 | 0 | 0 | 0 | 5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| GABackbone=LLaVA-13B2026.06 | 48.5 | — | — | — | — | — | — | — | — | — | — | 38.4 | 7 | 1 | 3.5 | 0 | 1.5 | 0 | 5.7 | 25 | 2.2 | 15 | 1.1 | 12.5 | 10 | 10 | 8 | 8 | 3 | 20 | |
| KLBackbone=LLaVA-13B2026.06 | 47 | — | — | — | — | — | — | — | — | — | — | 53.8 | 14.5 | 3 | 2 | 0 | 4 | 0 | 11.3 | 32.5 | 3 | 11.6 | 2.8 | 12.5 | 10.5 | 4 | 9.5 | 3.8 | 6.5 | 11.5 | |
| NPOBackbone=LLaVA-7B2026.06 | 42 | — | — | — | — | — | — | — | — | — | — | 23.8 | 0.5 | 0 | 0 | 0 | 0.5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| GABackbone=LLaVA-7B2026.06 | 38 | — | — | — | — | — | — | — | — | — | — | 12 | 19.5 | 2 | 3.5 | 0 | 1 | 1 | 22 | 10 | 13 | 4 | 7 | 4 | 18.5 | 3.8 | 7.5 | 1 | 6 | 2 | |
| GDBackbone=LLaVA-13B2026.06 | 34 | — | — | — | — | — | — | — | — | — | — | 6 | 0.5 | 0 | 0.5 | 0 | 0 | 0 | 0.5 | 25 | 1 | 17.5 | 0.5 | 12.5 | 2.5 | 6 | 1 | 7 | 2 | 4 | |
| GDBackbone=LLaVA-7B2026.06 | 33 | — | — | — | — | — | — | — | — | — | — | 14 | 11.5 | 6 | 1.5 | 1.5 | 0 | 0 | 15.3 | 12.5 | 4 | 6 | 3 | 4 | 11 | 5 | 3.5 | 1 | 4.5 | 1.5 | |
| KLBackbone=LLaVA-7B2026.06 | 28 | — | — | — | — | — | — | — | — | — | — | 12.3 | 11 | 5 | 0 | 0 | 0 | 0 | 18 | 11.6 | 0.5 | 1.6 | 0 | 0 | 1.5 | 1 | 0.5 | 0 | 0 | 0 | |
| GABackbone Model=Qwen3-VL-4B-Instruct2026.06 | — | 45 | 12.5 | 0.5 | 0 | 25.5 | 12.1 | 1.3 | 30.5 | 0.7 | 10.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GABackbone Model=Qwen3-VL-4B-Instruct2026.06 | — | 27.7 | 12.5 | 0.7 | 0 | 22.5 | 15.8 | 11.6 | 0.5 | 0 | 0.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GDBackbone Model=Qwen3-VL-4B-Instruct2026.06 | — | 54 | 11.5 | 3 | 0 | 18.7 | 9.6 | 3.9 | 20.5 | 6.5 | 6.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GDBackbone Model=Qwen3-VL-4B-Instruct2026.06 | — | 32.3 | 8.4 | 1.5 | 0 | 23.3 | 13.3 | 8.3 | 10 | 3.8 | 2.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LUMoEBackbone Model=Qwen3-VL-4B-Instruct2026.06 | — | 99 | 99 | 99 | 99 | 100 | 100 | 100 | 95 | 95 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LUMoEBackbone Model=Qwen3-VL-4B-Instruct2026.06 | — | 91 | 91 | 91 | 91 | 95 | 95 | 95 | 100 | 100 | 99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |