Training Data Extraction on EchoTrace
0.624ROUGE-LRECAP
Evaluation Results
| Method | Links | |
|---|---|---|
| RECAPTarget Model=Claude-3.72025.10 | 0.624 | |
| RECAPTarget Model=DeepSeek-V32025.10 | 0.535 | |
| DSP + JailbreakTarget Model=DeepSeek-V32025.10 | 0.478 | |
| RECAPTarget Model=GPT-4.12025.10 | 0.468 | |
| RECAPTarget Model=Avg.2025.10 | 0.46 | |
| DSPTarget Model=DeepSeek-V32025.10 | 0.449 | |
| DSP + JailbreakTarget Model=Claude-3.72025.10 | 0.441 | |
| DSP + JailbreakTarget Model=GPT-4.12025.10 | 0.396 | |
| DSPTarget Model=GPT-4.12025.10 | 0.379 | |
| DSP + JailbreakTarget Model=Avg.2025.10 | 0.366 | |
| DSPTarget Model=Avg.2025.10 | 0.258 | |
| RECAPTarget Model=Gemini-2.5-Pro2025.10 | 0.212 | |
| Prefix-ProbingTarget Model=GPT-4.12025.10 | 0.179 | |
| DSP + JailbreakTarget Model=Gemini-2.5-Pro2025.10 | 0.149 | |
| Prefix-ProbingTarget Model=DeepSeek-V32025.10 | 0.139 | |
| DSPTarget Model=Claude-3.72025.10 | 0.108 | |
| DSPTarget Model=Gemini-2.5-Pro2025.10 | 0.097 | |
| Prefix-ProbingTarget Model=Avg.2025.10 | 0.088 | |
| Prefix-ProbingTarget Model=Gemini-2.5-Pro2025.10 | 0.027 | |
| Prefix-ProbingTarget Model=Claude-3.72025.10 | 0.008 |