Privacy Attack on GPT-2 Small (124M)
0.68Validation CE LossBaseline DP-SGD
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Baseline DP-SGDNoise=0.0001, epsilon=inf2026.06 | 0.68 | — | — | — | — | — | — | |
| Poisoned DP-SGDNoise=0.0001, epsilon=inf2026.06 | 0.71 | 5.45 | 17.62 | — | — | — | — | |
| Baseline DP-SGDNoise=0.001, epsilon=inf2026.06 | 1.88 | — | — | — | — | — | — | |
| Poisoned DP-SGDNoise=0.001, epsilon=inf2026.06 | 1.9 | 0.4761 | 2.92 | — | — | — | — | |
| Poisoned DP-SGDNoise=0.01, epsilon=inf2026.06 | 3.2 | 0.4325 | 1.37 | — | — | — | — | |
| Baseline DP-SGDNoise=0.01, epsilon=inf2026.06 | 3.33 | — | — | — | — | — | — | |
| Baseline DP-SGDNoise=0.16, epsilon=5002026.06 | 3.71 | — | — | — | — | — | — | |
| Poisoned DP-SGDNoise=0.16, epsilon=5002026.06 | 3.76 | 0.0578 | 0.22 | — | — | — | — | |
| Baseline DP-SGDNoise=0.25, epsilon=1002026.06 | 3.98 | — | — | — | — | — | — | |
| Poisoned DP-SGDNoise=0.25, epsilon=1002026.06 | 4.01 | -0.034 | -0.59 | — | — | — | — | |
| Baseline DP-SGDNoise=0.41, epsilon=102026.06 | 4.77 | — | — | — | — | — | — | |
| Poisoned DP-SGDNoise=0.41, epsilon=102026.06 | 4.81 | -0.049 | -0.67 | — | — | — | — |