List your company
ResearchFormerly WizWand

Machine Unlearning on TOFU forget05 1.0

75.85Model Utility (MU)Base
-3.03417.445537.92558.4045Mar 1, 2026Mar 13, 2026Mar 25, 2026Apr 6, 2026Apr 18, 2026Apr 30, 2026May 12, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Base2026.0375.853.1939.52——
IDKVariant=AP2026.0375.2360.8868.05——
ME_KLTarget Model=Llama-3.1-8B, Method category=Convergence-based2026.0375.1470.1572.65——
MEVariant=GD2026.0374.9670.1572.56——
MEVariant=KL2026.0374.4370.4472.43——
ASUVariant=KL2026.0374.1877.8476.01——
ASUVariant=GD2026.0373.6277.5875.6——
IDK_APTarget Model=Llama-3.1-8B, Method category=Convergence-based2026.0372.7460.9366.83——
ASU_KLTarget Model=Llama-3.1-8B2026.0371.6774.0772.87——
RMU (KLR)Model=Llama-3.2-3B-Instruct2026.0567—16987
SimNPO (KLR)Model=Llama-3.2-3B-Instruct2026.0566—483788
GUARD-ITModel=Llama-3.2-3B-Instruct2026.0566—615783
SatImpModel=Llama-3.2-3B-Instruct2026.0564—483876
SimNPOModel=Llama-3.2-3B-Instruct2026.0564—392888
GradDiffModel=Llama-3.2-3B-Instruct2026.0562—7610029
WGAModel=Llama-3.2-3B-Instruct2026.0561—473888
GUARD-ITModel=Llama-3.2-1B-Instruct2026.0560—626381
RMUModel=Llama-3.2-3B-Instruct2026.0560—241588
NPO_KLTarget Model=Llama-3.1-8B, Method category=Divergence-based2026.0359.9960.7860.38——
SimNPO (KLR)Model=Llama-3.2-1B-Instruct2026.0559—453788
RMU (KLR)Model=Llama-3.2-1B-Instruct2026.0558—171090
NPOVariant=KL2026.0357.773.3565.52——
SatImpModel=Llama-3.2-1B-Instruct2026.0557—463993
SimNPOModel=Llama-3.2-1B-Instruct2026.0557—423391
NPOVariant=GD2026.0356.6273.3164.97——
WGAModel=Llama-3.2-1B-Instruct2026.0556—494389
RMUModel=Llama-3.2-1B-Instruct2026.0555—292089
UNDIALModel=Llama-3.2-3B-Instruct2026.0551—576483
UNDIALModel=Llama-3.2-1B-Instruct2026.0545—526287
GA_KLTarget Model=Llama-3.1-8B, Method category=Divergence-based2026.0336.34018.17——
NPOModel=Llama-3.2-3B-Instruct2026.0534—394690
GradDiffModel=Llama-3.2-1B-Instruct2026.0532—468223
NPO (KLR)Model=Llama-3.2-3B-Instruct2026.0531—374687
GAVariant=GD2026.0329.253.8916.57——
GAVariant=KL2026.0320.135.3912.76——
NPO (KLR)Model=Llama-3.2-1B-Instruct2026.053—54287
DPOModel=Llama-3.2-3B-Instruct2026.053—53464
DPOModel=Llama-3.2-1B-Instruct2026.052—43493
NPOModel=Llama-3.2-1B-Instruct2026.052—33785
DPO_KLTarget Model=Llama-3.1-8B, Method category=Convergence-based2026.031.7468.5135.12——
DPOVariant=GD2026.03077.1538.58——
DPOVariant=KL2026.03077.2238.61——
IDKVariant=GD2026.03070.1835.09——
IDKVariant=KL2026.03070.1835.09——
IDK_KLTarget Model=Llama-3.1-8B, Method category=Convergence-based2026.03064.6832.34——
CEUModel=Llama-3.2-1B-Instruct2026.050—0244
GAModel=Llama-3.2-1B-Instruct2026.050—09710
GradDiff (KLR)Model=Llama-3.2-1B-Instruct2026.050—06943
PDUModel=Llama-3.2-1B-Instruct2026.050—01419
CEUModel=Llama-3.2-3B-Instruct2026.050—0273
GAModel=Llama-3.2-3B-Instruct2026.050—01005
GradDiff (KLR)Model=Llama-3.2-3B-Instruct2026.050—0988
PDUModel=Llama-3.2-3B-Instruct2026.050—045