External Data Extraction Attack on HealthcareMagic-101
45.3RRZeng et al.
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Zeng et al.Target Model=Claude 3.72025.10 | 45.3 | 4.3 | 7.6 | |
| GCG LeakTarget Model=Claude 3.72025.10 | 34.3 | 1.8 | 6 | |
| Jiang et al.Target Model=Gemini 2.02025.10 | 16 | 14.1 | 25 | |
| Cohen et al.Target Model=Claude 3.72025.10 | 9 | 0 | 0 | |
| Zeng et al.Target Model=GPT-4o2025.10 | 3 | 14.8 | 23.1 | |
| Qi et al.Target Model=Claude 3.72025.10 | 2.7 | 5.9 | 11.1 | |
| Qi et al.Target Model=Gemini 2.02025.10 | 2.7 | 2.6 | 5.5 | |
| GCG LeakTarget Model=DeepSeek-V32025.10 | 2 | 19.1 | 29.5 | |
| Cohen et al.Target Model=GPT-4o2025.10 | 1 | 7.7 | 14.7 | |
| GCG LeakTarget Model=GPT-4o2025.10 | 0.7 | 18.8 | 27 | |
| GCG LeakTarget Model=Gemini 2.02025.10 | 0.3 | 16.8 | 27.3 | |
| Qi et al.Target Model=GPT-4o2025.10 | 0 | 11.7 | 18.2 | |
| Qi et al.Target Model=DeepSeek-V32025.10 | 0 | 12.4 | 19.3 | |
| Zeng et al.Target Model=Gemini 2.02025.10 | 0 | 15.4 | 23.5 | |
| Zeng et al.Target Model=DeepSeek-V32025.10 | 0 | 15 | 23.6 | |
| Cohen et al.Target Model=Gemini 2.02025.10 | 0 | 11.2 | 15.2 | |
| Cohen et al.Target Model=DeepSeek-V32025.10 | 0 | 11.6 | 16.1 | |
| Jiang et al.Target Model=Claude 3.72025.10 | 0 | 0 | 0 | |
| Jiang et al.Target Model=GPT-4o2025.10 | 0 | 22.5 | 39.2 | |
| Jiang et al.Target Model=DeepSeek-V32025.10 | 0 | 26 | 44.7 | |
| SECRETTarget Model=Claude 3.72025.10 | 0 | 25.5 | 36.5 | |
| SECRETTarget Model=Gemini 2.02025.10 | 0 | 28.6 | 49.1 | |
| SECRETTarget Model=GPT-4o2025.10 | 0 | 29.4 | 48.3 | |
| SECRETTarget Model=DeepSeek-V32025.10 | 0 | 30.4 | 48.7 |