List your company
ResearchFormerly WizWand

Lifelong Unlearning on MLUBench Task C v1.0 (test)

97Forget QualityLUMoE
-3.8822.3148.574.69Jun 11, 2026
Updated 4mo ago

Evaluation results

MethodLinks
LUMoEBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=Sequential (C-UC, C-UA, C-UB, C-UD)2026.069794
NPOBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task C (C-UC)2026.0693.55
GABackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task C (C-UC)2026.06936.9
KLBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task C (C-UC)2026.067715.4
GDBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task C (C-UC)2026.067021.5
GABackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task A (C-UA)2026.0617.52.3
GDBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task A (C-UA)2026.0617.53.8
KLBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task A (C-UA)2026.0615.55
GABackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task B (C-UB)2026.06100
GABackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task D (C-UD)2026.0660
GDBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task B (C-UB)2026.060.50
KLBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task B (C-UB)2026.0600
KLBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task D (C-UD)2026.0600
GDBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task D (C-UD)2026.0600
NPOBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task A (C-UA)2026.0600
NPOBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task B (C-UB)2026.0600
NPOBackbone=LLaVA-7B, Task Order=Task C -> Task A -> Task B -> Task D, Evaluation Stage=After unlearning Task D (C-UD)2026.0600