Memorized Content Extraction on EchoTrace (arXiv)
57.5ROUGE-LRECAP
Evaluation Results
| Method | Links | |
|---|---|---|
| RECAPModel=Claude-3.72025.10 | 57.5 | |
| RECAPModel=DeepSeek-V32025.10 | 44.7 | |
| RECAPModel=GPT-4.12025.10 | 44.5 | |
| DSPModel=Claude-3.72025.10 | 42.3 | |
| RECAPModel=Avg.2025.10 | 40.8 | |
| DSPModel=DeepSeek-V32025.10 | 36.2 | |
| DSPModel=GPT-4.12025.10 | 29.8 | |
| Prefix-ProbingModel=Claude-3.72025.10 | 29.1 | |
| DSPModel=Avg.2025.10 | 29.1 | |
| Prefix-ProbingModel=GPT-4.12025.10 | 18 | |
| Prefix-ProbingModel=DeepSeek-V32025.10 | 17.6 | |
| Prefix-ProbingModel=Avg.2025.10 | 17.2 | |
| RECAPModel=Gemini-2.5-Pro2025.10 | 16.5 | |
| DSPModel=Gemini-2.5-Pro2025.10 | 8.3 | |
| Prefix-ProbingModel=Gemini-2.5-Pro2025.10 | 4 |