Multi-agent privacy and utility evaluation on AgentLeak Hierarchical
87PrivacyFull-System LCGuard
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Full-System LCGuardBackbone=LLaMA-8B, #Agents=52026.05 | 87 | 62.5 | 70.3 | 13 | 30.5 | |
| ADAPTBackbone=LLaMA-8B, #Agents=52026.05 | 83.5 | 33.5 | 31.5 | 16.5 | 42 | |
| Per-Agent LCGuardBackbone=LLaMA-8B, #Agents=52026.05 | 80.5 | 59.5 | 64.1 | 19.5 | 35.5 | |
| Full-System LCGuardTopology=Hier, Number of Agents=5, Base Model=LLaMA-3B2026.05 | 80.5 | 59 | 69 | 19.5 | 33 | |
| ADAPTTopology=Hier, Number of Agents=5, Base Model=LLaMA-3B2026.05 | 78.5 | 31 | 25.5 | 21.5 | 43 | |
| Per-Agent LCGuardTopology=Hier, Number of Agents=5, Base Model=LLaMA-3B2026.05 | 74.5 | 57 | 61.5 | 25.5 | 37 | |
| PrivActBackbone=LLaMA-8B, #Agents=52026.05 | 54.5 | 57.5 | 44 | 45.5 | 75 | |
| PrivActTopology=Hier, Number of Agents=5, Base Model=LLaMA-3B2026.05 | 53 | 55.5 | 39.5 | 47 | 75 | |
| Vanilla KV Sharing (KVComm)Topology=Hier, Number of Agents=5, Base Model=LLaMA-3B2026.05 | 22 | 61 | 73 | 78 | 82 | |
| Vanilla KV Sharing (LatentMAS)Backbone=LLaMA-8B, #Agents=52026.05 | 21.5 | 66.5 | 81.5 | 78.5 | 78.5 |