List your company
ResearchFormerly WizWand

Knowledge Unlearning on The Pile 32 sample (val)

0EL10 (%)NEO + DPD+
-2.81616.19235.254.208Oct 4, 2022
Updated 8mo ago

Evaluation results

MethodLinks
NEO + DPD+Params=125M2022.10027.4
NEO + DPD+Params=1.3B2022.10021.4
NEO + DPD+Params=2.7B2022.10024.2
NEO + UL+Params=125M, Epoch=17.22022.10127.4
NEO + UL+Params=2.7B, Epoch=10.82022.101.631
NEO + UL+Params=1.3B, Epoch=13.82022.101.930.4
NEO + ULParams=125M, Epoch=112022.103.750.1
OPTParams=125M2022.108.652.9
NEO + ULParams=1.3B, Epoch=82022.101162.2
NEO + ULParams=2.7B, Epoch=5.42022.101366
OPTParams=1.3B2022.1023.367.1
OPTParams=2.7B2022.1025.669.2
NEOParams=125M2022.1030.977.4
NEOParams=1.3B2022.1067.692.2
NEOParams=2.7B2022.1070.493.4