List your company
ResearchFormerly WizWand

Privacy Editing on TDE Email

0LeakagePre Edit
-2.7215.643452.36Jun 9, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.0602,7920—
PMEModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.060———
MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.060———
GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.060———
PMEModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.060——100
DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.060——100
Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.0603,2250—
PMEModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.060———
MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.060———
GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.060———
PMEModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.060——100
PMEModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.060——100
MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.060——100
PMEModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.060——100
MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.060——100
DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.060——100
Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot c2025.0603,2290—
PMEModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.060——100
PMEModel=GPT-J 6B, Attack Variant=zero shot a2025.060——100
DeMemModel=GPT-J 6B, Attack Variant=zero shot a2025.060——100
PMEModel=GPT-J 6B, Attack Variant=zero shot b2025.060——100
PMEModel=GPT-J 6B, Attack Variant=zero shot c2025.060——100
DeMemModel=GPT-J 6B, Attack Variant=zero shot c2025.060——100
PMEModel=GPT-J 6B, Attack Variant=zero shot d2025.060——100
Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.0613,2190—
MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.061——0
GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.061——0
DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.061———
MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.061——93.75
Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.0611,6380.1—
GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.061——0
Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.0613,2300—
GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.061——0
DeMemModel=GPT-J 6B, Attack Variant=zero shot b2025.061——50
MEMITModel=GPT-J 6B, Attack Variant=zero shot d2025.061——98.53
DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.062——100
MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.062——95
Pre EditModel=GPT-J 6B, Attack Variant=zero shot b2025.0623,2290.1—
GRACEModel=GPT-J 6B, Attack Variant=zero shot b2025.062——0
DeMemModel=GPT-J 6B, Attack Variant=zero shot d2025.062——97.06
MEMITModel=GPT-J 6B, Attack Variant=zero shot b2025.063——50
MEMITModel=GPT-J 6B, Attack Variant=zero shot a2025.064——20
MEMITModel=GPT-J 6B, Attack Variant=zero shot c2025.064——84.62
Pre EditModel=GPT-J 6B, Attack Variant=zero shot a2025.0653,1300.2—
GRACEModel=GPT-J 6B, Attack Variant=zero shot a2025.065——0
DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.069———
DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.0610——37.5
Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06163,2320.5—
GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.0616——0
DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.0616——60
Pre EditModel=GPT-J 6B, Attack Variant=zero shot c2025.06263,2340.8—
GRACEModel=GPT-J 6B, Attack Variant=zero shot c2025.0626——0
Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06403,2381.2—
GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.0640——0
Pre EditModel=GPT-J 6B, Attack Variant=zero shot d2025.06683,2372.1—
GRACEModel=GPT-J 6B, Attack Variant=zero shot d2025.0668——0