Privacy and utility evaluation in multi-agent communication on PrivacyLens
86.5Privacy ScoreADAPT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ADAPTTopology=Seq, #Agents=4, Backbone=Qwen3-8B2026.05 | 86.5 | 44.5 | 30 | 13.5 | 43 | |
| Full-System LCGuardTopology=Hier, #Agents=5, Backbone=Qwen3-8B2026.05 | 86.5 | 72 | 72.5 | 13.5 | 34.5 | |
| ADAPTTopology=Hier, #Agents=5, Backbone=Qwen3-8B2026.05 | 85.5 | 43.5 | 28.5 | 14.5 | 45.5 | |
| Full-System LCGuardTopology=Graph, #Agents=5, Backbone=Qwen3-8B2026.05 | 84.5 | 70.5 | 70.5 | 15.5 | 37 | |
| Full-System LCGuardTopology=Seq, #Agents=4, Backbone=Qwen3-8B2026.05 | 84 | 73 | 73 | 16 | 32 | |
| ADAPTTopology=Graph, #Agents=5, Backbone=Qwen3-8B2026.05 | 83.5 | 41.5 | 25.5 | 16.5 | 49 | |
| PrivActTopology=Seq, #Agents=4, Backbone=Qwen3-8B2026.05 | 81.5 | 71 | 42 | 18.5 | 77 | |
| PrivActTopology=Hier, #Agents=5, Backbone=Qwen3-8B2026.05 | 80.5 | 70.5 | 40 | 19.5 | 79 | |
| Per-Agent LCGuardTopology=Hier, #Agents=5, Backbone=Qwen3-8B2026.05 | 80 | 69.5 | 61.5 | 20 | 39 | |
| Per-Agent LCGuardTopology=Seq, #Agents=4, Backbone=Qwen3-8B2026.05 | 79.5 | 70 | 65 | 20.5 | 36.5 | |
| PrivActTopology=Graph, #Agents=5, Backbone=Qwen3-8B2026.05 | 78.5 | 69 | 37.5 | 21.5 | 83.5 | |
| Per-Agent LCGuardTopology=Graph, #Agents=5, Backbone=Qwen3-8B2026.05 | 77.5 | 68 | 65.5 | 22.5 | 42 | |
| Vanilla KV Sharing (LatentMAS)Topology=Seq, #Agents=4, Backbone=Qwen3-8B2026.05 | 45.5 | 75 | 80 | 54.5 | 81 | |
| Vanilla KV Sharing (LatentMAS)Topology=Hier, #Agents=5, Backbone=Qwen3-8B2026.05 | 43 | 74 | 77.5 | 57 | 83.5 | |
| Vanilla KV Sharing (LatentMAS)Topology=Graph, #Agents=5, Backbone=Qwen3-8B2026.05 | 40.5 | 72.5 | 74.5 | 59.5 | 87 |