List your company

Machine Unlearning on TOFU (1% Forget Data)

97.88UFEDualOptim+
72.368878.991985.61592.2381May 20, 2026

Evaluation results

MethodLinks
DualOptim+Backbone=Llama 2, Loss Function=ME+GD (untargeted)2026.0597.88—75.8286.85
DualOptim 8bitBackbone=Llama 2, Loss Function=ME+GD (untargeted), Optimizer Precision=8-bit2026.0597.76—75.5586.66
DualOptim+ 8bitBackbone=Llama 2, Loss Function=ME+GD (untargeted), Optimizer Precision=8-bit2026.0597.5—75.0186.26
DualOptimBackbone=Llama 2, Loss Function=ME+GD (untargeted)2026.0597.46—75.0686.26
AlternateBackbone=Llama 2, Loss Function=ME+GD (untargeted)2026.0597.25—74.8986.07
JointBackbone=Llama 2, Loss Function=ME+GD (untargeted)2026.0595.89—59.777.8
JointBackbone=Phi 1.5, Loss Function=ME+GD (untargeted)2026.0595.41—11.4553.43
DualOptim+Backbone=Phi 1.5, Loss Function=ME+GD (untargeted)2026.0593.92—46.1970.06
DualOptim 8bitBackbone=Phi 1.5, Loss Function=ME+GD (untargeted), Optimizer Precision=8-bit2026.0592.83—45.7569.29
DualOptimBackbone=Phi 1.5, Loss Function=ME+GD (untargeted)2026.0592.79—45.2669.03
DualOptim+ 8bitBackbone=Phi 1.5, Loss Function=ME+GD (untargeted), Optimizer Precision=8-bit2026.0592.48—46.1669.32
AlternateBackbone=Phi 1.5, Loss Function=ME+GD (untargeted)2026.0591.46—45.7868.62
JointBackbone=Llama 2, Loss Function=IDK+GD (targeted)2026.0585.9659.538.6255.68
DualOptimBackbone=Llama 2, Loss Function=IDK+GD (targeted)2026.0583.1266.4173.8374.3
DualOptim 8bitBackbone=Llama 2, Loss Function=IDK+GD (targeted), Optimizer Precision=8-bit2026.0583.1166.4173.7774.27
AlternateBackbone=Llama 2, Loss Function=IDK+GD (targeted)2026.0581.9766.4173.9374.06
DualOptim+ 8bitBackbone=Llama 2, Loss Function=IDK+GD (targeted), Optimizer Precision=8-bit2026.0579.0566.4176.5374.63
DualOptim+Backbone=Llama 2, Loss Function=IDK+GD (targeted)2026.0578.7666.4177.474.99
JointBackbone=Phi 1.5, Loss Function=IDK+GD (targeted)2026.0578.1145.4518.6140.19
DualOptim 8bitBackbone=Phi 1.5, Loss Function=IDK+GD (targeted), Optimizer Precision=8-bit2026.0575.5861.2346.7357.57
DualOptim+Backbone=Phi 1.5, Loss Function=IDK+GD (targeted)2026.0575.5167.8547.6959.69
DualOptimBackbone=Phi 1.5, Loss Function=IDK+GD (targeted)2026.0574.7563.5146.4657.8
DualOptim+ 8bitBackbone=Phi 1.5, Loss Function=IDK+GD (targeted), Optimizer Precision=8-bit2026.0573.6968.3647.5359.28
AlternateBackbone=Phi 1.5, Loss Function=IDK+GD (targeted)2026.0573.3562.4948.1458.03