Data Extraction Attack on Agent Memory on RAP (test)
71Equality ScoreADAM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ADAMLLM=ChatGPT-42026.04 | 71 | 78 | |
| ADAMLLM=Qwen2-72B2026.04 | 67 | 74 | |
| ADAMLLM=Mistral-7B-Instruct2026.04 | 61 | 68 | |
| ADAMLLM=LLaMA2-7B-Chat2026.04 | 54 | 60 | |
| PirateLLM=ChatGPT-42026.04 | 46 | 51 | |
| PirateLLM=Qwen2-72B2026.04 | 45 | 50 | |
| PirateLLM=Mistral-7B-Instruct2026.04 | 41 | 46 | |
| PirateLLM=LLaMA2-7B-Chat2026.04 | 37 | 75 | |
| MEXTRALLM=ChatGPT-42026.04 | 35 | 39 | |
| MEXTRALLM=Qwen2-72B2026.04 | 31 | 34 | |
| MEXTRALLM=Mistral-7B-Instruct2026.04 | 29 | 32 | |
| MEXTRALLM=LLaMA2-7B-Chat2026.04 | 27 | 30 |