Training Data Extraction on EchoTrace (Public Domain)
81.9ROUGE-LRECAP
Evaluation results
| Method | Links | |
|---|---|---|
| RECAPTarget Model=Claude-3.72025.10 | 81.9 | |
| RECAPTarget Model=DeepSeek-V32025.10 | 76 | |
| DSP + JailbreakTarget Model=DeepSeek-V32025.10 | 68.4 | |
| RECAPTarget Model=GPT-4.12025.10 | 65.2 | |
| DSPTarget Model=DeepSeek-V32025.10 | 63.2 | |
| RECAPTarget Model=Avg.2025.10 | 62.1 | |
| DSP + JailbreakTarget Model=Claude-3.72025.10 | 59.2 | |
| DSP + JailbreakTarget Model=GPT-4.12025.10 | 56.8 | |
| DSPTarget Model=GPT-4.12025.10 | 53.4 | |
| DSP + JailbreakTarget Model=Avg.2025.10 | 50.9 | |
| DSPTarget Model=Avg.2025.10 | 39.3 | |
| DSPTarget Model=Claude-3.72025.10 | 28.8 | |
| Prefix-ProbingTarget Model=GPT-4.12025.10 | 27.5 | |
| RECAPTarget Model=Gemini-2.5-Pro2025.10 | 25.5 | |
| DSP + JailbreakTarget Model=Gemini-2.5-Pro2025.10 | 19.2 | |
| Prefix-ProbingTarget Model=DeepSeek-V32025.10 | 16.4 | |
| Prefix-ProbingTarget Model=Avg.2025.10 | 13.3 | |
| DSPTarget Model=Gemini-2.5-Pro2025.10 | 11.9 | |
| Prefix-ProbingTarget Model=Claude-3.72025.10 | 5.1 | |
| Prefix-ProbingTarget Model=Gemini-2.5-Pro2025.10 | 4.2 |