Secret Data Extraction Attack on FedLLM 100 Target Secrets
100Success Rate (P > .10)GPT-2 Small (124M)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-2 Small (124M)Setting=After poisoning2026.06 | 100 | 93 | |
| GPT-Neo (125M)Setting=After poisoning2026.06 | 100 | 94 | |
| Pythia (160M)Setting=After poisoning2026.06 | 100 | 96 | |
| OPT (250M)Setting=After poisoning2026.06 | 100 | 99 | |
| GPT-2 Medium (355M)Setting=After poisoning2026.06 | 100 | 100 | |
| Llama2 (13B)Setting=After poisoning2026.06 | 100 | 97 | |
| DistilGPT-2 (82M)Setting=After poisoning2026.06 | 99 | 85 | |
| Llama2 (7B)Setting=After poisoning2026.06 | 99 | 83 | |
| Llama3.2 (1B)Setting=After poisoning2026.06 | 97 | 92 | |
| GPT-2 Medium (355M)Setting=Baseline setting2026.06 | 23 | 7 | |
| OPT (250M)Setting=Baseline setting2026.06 | 21 | 3 | |
| Pythia (160M)Setting=Baseline setting2026.06 | 17 | 0 | |
| GPT-Neo (125M)Setting=Baseline setting2026.06 | 13 | 0 | |
| GPT-2 Small (124M)Setting=Baseline setting2026.06 | 12 | 0 | |
| DistilGPT-2 (82M)Setting=Baseline setting2026.06 | 9 | 0 | |
| Llama2 (7B)Setting=Baseline setting2026.06 | 0 | 0 | |
| Llama2 (13B)Setting=Baseline setting2026.06 | 0 | 0 | |
| Llama3.2 (1B)Setting=Baseline setting2026.06 | 0 | 0 |