Privacy Editing on TDE URL
0LeakagePME
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| PMEModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT Neo 2.7B, Attack Variant=zero shot c2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 0 | — | — | 100 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 0 | — | — | 100 | |
| PMEModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 1 | — | — | 50 | |
| MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 1 | — | — | 50 | |
| DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 1 | — | — | 50 | |
| MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 1 | — | — | 66.67 | |
| Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot c2025.06 | 1 | 1,104 | 10 | — | |
| MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot c2025.06 | 1 | — | — | 0 | |
| GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot c2025.06 | 1 | — | — | 0 | |
| DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot c2025.06 | 1 | — | — | 0 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 1 | — | — | 50 | |
| DeMemModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 1 | — | — | 50 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 1 | 2,938 | 0 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 1 | — | — | 0 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 1 | — | — | 80 | |
| PMEModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 2 | — | — | 60 | |
| Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 2 | 1,803 | 10 | — | |
| GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot c2025.06 | 2 | — | — | 0 | |
| DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 2 | — | — | 33.33 | |
| PMEModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 2 | — | — | 33.33 | |
| DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 2 | — | — | 33.33 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 2 | 3,346 | 10 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot a2025.06 | 2 | — | — | 0 | |
| MEMITModel=GPT-J 6B, Attack Variant=zero shot b2025.06 | 2 | — | — | 100 | |
| MEMITModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 3 | — | — | 40 | |
| Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 3 | 456 | 70 | — | |
| GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot d2025.06 | 3 | — | — | 0 | |
| Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 3 | 3,806 | 10 | — | |
| GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 3 | — | — | 0 | |
| MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 3 | — | — | 25 | |
| DeMemModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 3 | — | — | 25 | |
| Pre EditModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 4 | 495 | 80 | — | |
| GRACEModel=GPT Neo 2.7B, Attack Variant=zero shot d2025.06 | 4 | — | — | 0 | |
| Pre EditModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 5 | 3,783 | 10 | — | |
| GRACEModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 5 | — | — | 0 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 5 | 1,885 | 30 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot c2025.06 | 5 | — | — | 0 | |
| Pre EditModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 5 | 478 | 100 | — | |
| GRACEModel=GPT-J 6B, Attack Variant=zero shot d2025.06 | 5 | — | — | 0 | |
| DeMemModel=GPT Neo 1.3B, Attack Variant=zero shot a2025.06 | 6 | — | — | 20 | |
| MEMITModel=GPT Neo 2.7B, Attack Variant=zero shot a2025.06 | 6 | — | — | 100 |