Data Extraction Attack on Agent Memory on ReAct (test)
81EQ ScoreADAM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ADAMLLM=ChatGPT-42026.04 | 81 | 90 | |
| ADAMLLM=Qwen2-72B2026.04 | 75 | 83 | |
| ADAMLLM=LLaMA2-7B-Chat2026.04 | 73 | 81 | |
| ADAMLLM=Mistral-7B-Instruct2026.04 | 70 | 78 | |
| PirateLLM=Mistral-7B-Instruct2026.04 | 51 | 57 | |
| PirateLLM=Qwen2-72B2026.04 | 50 | 56 | |
| PirateLLM=ChatGPT-42026.04 | 48 | 53 | |
| PirateLLM=LLaMA2-7B-Chat2026.04 | 46 | 51 | |
| MEXTRALLM=Qwen2-72B2026.04 | 40 | 44 | |
| MEXTRALLM=ChatGPT-42026.04 | 39 | 43 | |
| MEXTRALLM=LLaMA2-7B-Chat2026.04 | 38 | 42 | |
| MEXTRALLM=Mistral-7B-Instruct2026.04 | 36 | 40 |