List your company
ResearchFormerly WizWand

Concept Erasure on 39 NLP settings (13 LLMs x 3 concepts)

0Mean Residual Leakage |DS|Obliviator
-0.7644.3939.5514.707Jul 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ObliviatorSurgicality budget (DY)=≤ 1pp, Protocol=Alone2026.0700.3333
ObliviatorSurgicality budget (DY)=≤ 1pp, Protocol=+MANCE2026.0700.3333
ObliviatorSurgicality budget (DY)=≤ 3pp, Protocol=Alone2026.0700.3333
ObliviatorSurgicality budget (DY)=≤ 3pp, Protocol=+MANCE2026.0700.3333
ObliviatorSurgicality budget (DY)=≤ 5pp, Protocol=Alone2026.0700.3333
ObliviatorSurgicality budget (DY)=≤ 5pp, Protocol=+MANCE2026.0700.3333
ObliviatorSurgicality budget (DY)=≤ 10pp, Protocol=Alone2026.0700.4872
ObliviatorSurgicality budget (DY)=≤ 10pp, Protocol=+MANCE2026.0700.4872
MANCE++Surgicality budget (DY)=≤ 10pp, Protocol=+MANCE2026.0701
MANCE++Surgicality budget (DY)=≤ 3pp, Protocol=+MANCE2026.070.10.9487
MANCE++Surgicality budget (DY)=≤ 5pp, Protocol=+MANCE2026.070.10.9744
IGBPSurgicality budget (DY)=≤ 10pp, Protocol=+MANCE2026.070.61
MANCE+Surgicality budget (DY)=≤ 10pp, Protocol=+MANCE2026.070.61
IGBPSurgicality budget (DY)=≤ 5pp, Protocol=+MANCE2026.070.71
MANCE+Surgicality budget (DY)=≤ 5pp, Protocol=+MANCE2026.070.71
IGBPSurgicality budget (DY)=≤ 3pp, Protocol=+MANCE2026.070.91
INLPSurgicality budget (DY)=≤ 10pp, Protocol=+MANCE2026.0711
MANCE+Surgicality budget (DY)=≤ 3pp, Protocol=+MANCE2026.0711
INLPSurgicality budget (DY)=≤ 5pp, Protocol=+MANCE2026.071.11
INLPSurgicality budget (DY)=≤ 3pp, Protocol=+MANCE2026.071.51
MANCE+Surgicality budget (DY)=≤ 1pp, Protocol=+MANCE2026.071.50.9744
IGBPSurgicality budget (DY)=≤ 1pp, Protocol=+MANCE2026.071.60.9744
MANCE (no preprocessing)Surgicality budget (DY)=≤ 10pp, Protocol=+MANCE2026.071.71
MANCE++Surgicality budget (DY)=≤ 1pp, Protocol=+MANCE2026.071.70.8462
INLPSurgicality budget (DY)=≤ 1pp, Protocol=+MANCE2026.071.80.9744
MANCE (no preprocessing)Surgicality budget (DY)=≤ 5pp, Protocol=+MANCE2026.072.21
MANCE (no preprocessing)Surgicality budget (DY)=≤ 3pp, Protocol=+MANCE2026.072.40.9744
MANCE (no preprocessing)Surgicality budget (DY)=≤ 1pp, Protocol=+MANCE2026.074.50.9487
IGBPSurgicality budget (DY)=≤ 1pp, Protocol=Alone2026.0711.50.9744
IGBPSurgicality budget (DY)=≤ 3pp, Protocol=Alone2026.0711.51
IGBPSurgicality budget (DY)=≤ 5pp, Protocol=Alone2026.0711.51
IGBPSurgicality budget (DY)=≤ 10pp, Protocol=Alone2026.0711.51
INLPSurgicality budget (DY)=≤ 1pp, Protocol=Alone2026.0715.20.9231
INLPSurgicality budget (DY)=≤ 3pp, Protocol=Alone2026.0715.60.9487
INLPSurgicality budget (DY)=≤ 5pp, Protocol=Alone2026.07161
INLPSurgicality budget (DY)=≤ 10pp, Protocol=Alone2026.07161
LEACESurgicality budget (DY)=≤ 3pp, Protocol=Alone2026.07191
LEACESurgicality budget (DY)=≤ 5pp, Protocol=Alone2026.07191
LEACESurgicality budget (DY)=≤ 10pp, Protocol=Alone2026.07191
LEACESurgicality budget (DY)=≤ 1pp, Protocol=Alone2026.0719.10.9744