Privacy Defense Against Classification Attack on Legal
94.7Attack ScoreNo Defense
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| No DefenseBackbone model=LLaMA-2-7B, Split layer (k)=42026.06 | 94.7 | 10 | |
| FisherBackbone model=LLaMA-2-7B, Split layer (k)=42026.06 | 94.7 | 290.6 | |
| PCABackbone model=LLaMA-2-7B, Split layer (k)=4, PCA k=2562026.06 | 94.6 | 12.1 | |
| PCABackbone model=LLaMA-2-7B, Split layer (k)=4, PCA k=5122026.06 | 94.6 | 10.7 | |
| NoPeekBackbone model=LLaMA-2-7B, Split layer (k)=42026.06 | 92.5 | 67.4 | |
| GaussianBackbone model=LLaMA-2-7B, Split layer (k)=4, σ=0.12026.06 | 89.4 | 12.3 | |
| LaplaceBackbone model=LLaMA-2-7B, Split layer (k)=4, b=0.12026.06 | 85.8 | 17.4 | |
| GaussianBackbone model=LLaMA-2-7B, Split layer (k)=4, σ=0.52026.06 | 56.2 | 903 | |
| Privacy AdaptersBackbone model=LLaMA-2-7B, Split layer (k)=4, r=256, λ=0.52026.06 | 51.2 | 11.9 | |
| LaplaceBackbone model=LLaMA-2-7B, Split layer (k)=4, b=0.52026.06 | 43.9 | 2,636 | |
| ShredMIBackbone model=LLaMA-2-7B, Split layer (k)=4, r=2562026.06 | 17.9 | 1,452 |