Untargeted Reconstruction Attack on ChatDoctor 250 adversarial prompts
40Repeat PromptNaive RAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Naive RAGLLM Backbone=GPT-3.5-Turbo2026.06 | 40 | 61 | |
| Naive RAGLLM Backbone=DeepSeek-V32026.06 | 34 | 56 | |
| Naive RAGLLM Backbone=GPT-4o-mini2026.06 | 31 | 55 | |
| Naive RAGLLM Backbone=LLaMA-3-8B2026.06 | 27 | 65 | |
| Naive RAGLLM Backbone=DeepSeek-R12026.06 | 25 | 40 | |
| Naive RAGLLM Backbone=QWQ-32B2026.06 | 21 | 62 | |
| Single AgentLLM Backbone=GPT-3.5-Turbo2026.06 | 7 | 10 | |
| Single AgentLLM Backbone=DeepSeek-V32026.06 | 6 | 11 | |
| Single AgentLLM Backbone=LLaMA-3-8B2026.06 | 5 | 11 | |
| Single AgentLLM Backbone=GPT-4o-mini2026.06 | 5 | 10 | |
| Single AgentLLM Backbone=DeepSeek-R12026.06 | 4 | 9 | |
| Single AgentLLM Backbone=QWQ-32B2026.06 | 4 | 10 | |
| Adv-AnonLLM Backbone=LLaMA-3-8B2026.06 | 2 | 6 | |
| Adv-AnonLLM Backbone=GPT-3.5-Turbo2026.06 | 2 | 5 | |
| Adv-AnonLLM Backbone=GPT-4o-mini2026.06 | 2 | 6 | |
| Adv-AnonLLM Backbone=DeepSeek-V32026.06 | 2 | 5 | |
| Adv-AnonLLM Backbone=DeepSeek-R12026.06 | 2 | 5 | |
| Adv-AnonLLM Backbone=QWQ-32B2026.06 | 1 | 5 | |
| AttrPromptLLM Backbone=LLaMA-3-8B2026.06 | 0 | 0 | |
| SAGELLM Backbone=LLaMA-3-8B2026.06 | 0 | 2 | |
| KG-PrivRAGLLM Backbone=LLaMA-3-8B2026.06 | 0 | 3 | |
| Multi-Agent Semantic Rewriting FrameworkLLM Backbone=LLaMA-3-8B2026.06 | 0 | 1 | |
| AttrPromptLLM Backbone=GPT-3.5-Turbo2026.06 | 0 | 0 | |
| SAGELLM Backbone=GPT-3.5-Turbo2026.06 | 0 | 1 | |
| KG-PrivRAGLLM Backbone=GPT-3.5-Turbo2026.06 | 0 | 2 | |
| Multi-Agent Semantic Rewriting FrameworkLLM Backbone=GPT-3.5-Turbo2026.06 | 0 | 2 | |
| AttrPromptLLM Backbone=GPT-4o-mini2026.06 | 0 | 0 | |
| SAGELLM Backbone=GPT-4o-mini2026.06 | 0 | 2 | |
| KG-PrivRAGLLM Backbone=GPT-4o-mini2026.06 | 0 | 3 | |
| Multi-Agent Semantic Rewriting FrameworkLLM Backbone=GPT-4o-mini2026.06 | 0 | 2 | |
| AttrPromptLLM Backbone=DeepSeek-V32026.06 | 0 | 0 | |
| SAGELLM Backbone=DeepSeek-V32026.06 | 0 | 2 | |
| KG-PrivRAGLLM Backbone=DeepSeek-V32026.06 | 0 | 2 | |
| Multi-Agent Semantic Rewriting FrameworkLLM Backbone=DeepSeek-V32026.06 | 0 | 1 | |
| AttrPromptLLM Backbone=DeepSeek-R12026.06 | 0 | 0 | |
| SAGELLM Backbone=DeepSeek-R12026.06 | 0 | 2 | |
| KG-PrivRAGLLM Backbone=DeepSeek-R12026.06 | 0 | 3 | |
| Multi-Agent Semantic Rewriting FrameworkLLM Backbone=DeepSeek-R12026.06 | 0 | 4 | |
| AttrPromptLLM Backbone=QWQ-32B2026.06 | 0 | 0 | |
| SAGELLM Backbone=QWQ-32B2026.06 | 0 | 1 | |
| KG-PrivRAGLLM Backbone=QWQ-32B2026.06 | 0 | 2 | |
| Multi-Agent Semantic Rewriting FrameworkLLM Backbone=QWQ-32B2026.06 | 0 | 1 |