Multi-agent privacy and utility evaluation on AgentLeak Sequential
86PrivacyFull-System LCGuard
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Full-System LCGuardBackbone=LLaMA-8B, #Agents=32026.05 | 86 | 65.5 | 69.1 | 14 | 28.5 | |
| ADAPTBackbone=LLaMA-8B, #Agents=32026.05 | 84 | 35.5 | 33 | 16 | 39.5 | |
| Full-System LCGuardTopology=Seq, Number of Agents=3, Base Model=LLaMA-3B2026.05 | 81 | 60 | 69 | 19 | 30 | |
| Per-Agent LCGuardBackbone=LLaMA-8B, #Agents=32026.05 | 80 | 60.5 | 63.5 | 20 | 33 | |
| ADAPTTopology=Seq, Number of Agents=3, Base Model=LLaMA-3B2026.05 | 80 | 32 | 26 | 20 | 41 | |
| Per-Agent LCGuardTopology=Seq, Number of Agents=3, Base Model=LLaMA-3B2026.05 | 75 | 58 | 63 | 25 | 34 | |
| PrivActBackbone=LLaMA-8B, #Agents=32026.05 | 56.5 | 55.5 | 45.5 | 43.5 | 73.5 | |
| PrivActTopology=Seq, Number of Agents=3, Base Model=LLaMA-3B2026.05 | 55 | 54 | 42 | 45 | 73 | |
| Vanilla KV Sharing (KVComm)Topology=Seq, Number of Agents=3, Base Model=LLaMA-3B2026.05 | 24 | 62 | 75 | 76 | 80 | |
| Vanilla KV Sharing (LatentMAS)Backbone=LLaMA-8B, #Agents=32026.05 | 23.5 | 67.5 | 83.5 | 76.5 | 76 |