Privacy Editing on TDE Email
0LeakagePre Edit
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 0 | 2,792 | 0 | — | |
| PMEModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 0 | — | — | — | |
| MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 0 | — | — | — | |
| GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 0 | — | — | — | |
| PMEModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 0 | 3,225 | 0 | — | |
| PMEModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 0 | — | — | — | |
| MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 0 | — | — | — | |
| GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 0 | — | — | — | |
| PMEModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 0 | — | — | 100 | |
| MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot c2025.06 | 0 | 3,229 | 0 | — | |
| PMEModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 0 | — | — | 100 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 0 | — | — | 100 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.06 | 1 | 3,219 | 0 | — | |
| MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.06 | 1 | — | — | 0 | |
| GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot b2025.06 | 1 | — | — | 0 | |
| DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 1 | — | — | — | |
| MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 1 | — | — | 93.75 | |
| Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 1 | 1,638 | 0.1 | — | |
| GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 1 | — | — | 0 | |
| Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.06 | 1 | 3,230 | 0 | — | |
| GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot b2025.06 | 1 | — | — | 0 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 1 | — | — | 50 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 1 | — | — | 98.53 | |
| DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 2 | — | — | 100 | |
| MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 2 | — | — | 95 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 2 | 3,229 | 0.1 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 2 | — | — | 0 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 2 | — | — | 97.06 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 3 | — | — | 50 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 4 | — | — | 20 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 4 | — | — | 84.62 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 5 | 3,130 | 0.2 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 5 | — | — | 0 | |
| DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 9 | — | — | — | |
| DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 10 | — | — | 37.5 | |
| Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 16 | 3,232 | 0.5 | — | |
| GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 16 | — | — | 0 | |
| DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 16 | — | — | 60 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 26 | 3,234 | 0.8 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 26 | — | — | 0 | |
| Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 40 | 3,238 | 1.2 | — | |
| GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 40 | — | — | 0 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 68 | 3,237 | 2.1 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 68 | — | — | 0 |