PII leakage evaluation on SPIRIT
1.12PII Leakage RateGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oTopology=Tree, Num Agents=52025.12 | 1.12 | |
| GPT-4oTopology=Star-Pure, Num Agents=62025.12 | 1.92 | |
| GPT-4oTopology=Chain, Num Agents=62025.12 | 1.99 | |
| GPT-4oTopology=Tree, Num Agents=62025.12 | 2.12 | |
| GPT-4oTopology=Circle, Num Agents=52025.12 | 2.24 | |
| GPT-4oTopology=Star-Pure, Num Agents=42025.12 | 2.24 | |
| GPT-4oTopology=Star-Ring, Num Agents=62025.12 | 2.32 | |
| GPT-4oTopology=Star-Ring, Num Agents=52025.12 | 2.4 | |
| GPT-4oTopology=Tree, Num Agents=42025.12 | 2.48 | |
| GPT-4oTopology=Star-Pure, Num Agents=52025.12 | 2.67 | |
| GPT-4oTopology=Chain, Num Agents=52025.12 | 2.8 | |
| GPT-4oTopology=Chain, Num Agents=42025.12 | 2.88 | |
| GPT-4oTopology=Circle, Num Agents=62025.12 | 2.99 | |
| GPT-4oTopology=Complete, Num Agents=52025.12 | 3.2 | |
| GPT-4o-miniTopology=Star-Ring, Num Agents=62025.12 | 3.2 | |
| GPT-4o-miniTopology=Circle, Num Agents=62025.12 | 3.63 | |
| GPT-4oTopology=Circle, Num Agents=42025.12 | 3.69 | |
| GPT-4o-miniTopology=Star-Pure, Num Agents=62025.12 | 3.95 | |
| GPT-4o-miniTopology=Chain, Num Agents=62025.12 | 3.95 | |
| GPT-4o-miniTopology=Tree, Num Agents=52025.12 | 3.95 | |
| GPT-4oTopology=Complete, Num Agents=62025.12 | 4.16 | |
| GPT-4oTopology=Complete, Num Agents=42025.12 | 4.17 | |
| GPT-4o-miniTopology=Star-Ring, Num Agents=52025.12 | 4.17 | |
| GPT-4o-miniTopology=Complete, Num Agents=62025.12 | 4.27 | |
| GPT-4oTopology=Star-Ring, Num Agents=42025.12 | 4.59 | |
| GPT-4o-miniTopology=Circle, Num Agents=52025.12 | 4.65 | |
| GPT-4o-miniTopology=Complete, Num Agents=52025.12 | 4.65 | |
| GPT-4o-miniTopology=Chain, Num Agents=42025.12 | 4.7 | |
| GPT-4o-miniTopology=Star-Ring, Num Agents=42025.12 | 5.13 | |
| GPT-4o-miniTopology=Tree, Num Agents=62025.12 | 5.17 | |
| GPT-4o-miniTopology=Chain, Num Agents=52025.12 | 5.18 | |
| GPT-4o-miniTopology=Complete, Num Agents=42025.12 | 5.29 | |
| GPT-4o-miniTopology=Star-Pure, Num Agents=42025.12 | 6.31 | |
| GPT-4o-miniTopology=Tree, Num Agents=42025.12 | 6.41 | |
| GPT-4o-miniTopology=Star-Pure, Num Agents=52025.12 | 6.52 | |
| Llama3.1-70bTopology=Tree, Num Agents=52025.12 | 7.17 | |
| GPT-4o-miniTopology=Circle, Num Agents=42025.12 | 7.53 | |
| DeepSeek-v3.1Topology=Chain, Num Agents=62025.12 | 11.3 | |
| DeepSeek-v3.1Topology=Tree, Num Agents=52025.12 | 11.49 | |
| DeepSeek-v3.1Topology=Chain, Num Agents=42025.12 | 11.7 | |
| DeepSeek-v3.1Topology=Circle, Num Agents=52025.12 | 11.86 | |
| DeepSeek-v3.1Topology=Tree, Num Agents=62025.12 | 12.14 | |
| DeepSeek-v3.1Topology=Circle, Num Agents=62025.12 | 12.5 | |
| Llama3.1-70bTopology=Chain, Num Agents=62025.12 | 12.84 | |
| DeepSeek-v3.1Topology=Chain, Num Agents=52025.12 | 13.09 | |
| DeepSeek-v3.1Topology=Star-Pure, Num Agents=42025.12 | 14.32 | |
| DeepSeek-v3.1Topology=Star-Ring, Num Agents=42025.12 | 14.64 | |
| DeepSeek-v3.1Topology=Star-Ring, Num Agents=62025.12 | 14.9 | |
| DeepSeek-v3.1Topology=Tree, Num Agents=42025.12 | 14.98 | |
| DeepSeek-v3.1Topology=Circle, Num Agents=42025.12 | 15.39 | |
| Llama3.1-70bTopology=Tree, Num Agents=62025.12 | 15.4 | |
| DeepSeek-v3.1Topology=Star-Pure, Num Agents=52025.12 | 15.7 | |
| Llama3.1-70bTopology=Chain, Num Agents=52025.12 | 15.89 | |
| DeepSeek-v3.1Topology=Star-Pure, Num Agents=62025.12 | 16.13 | |
| DeepSeek-v3.1Topology=Complete, Num Agents=42025.12 | 16.35 | |
| DeepSeek-v3.1Topology=Star-Ring, Num Agents=52025.12 | 16.67 | |
| Llama3.1-70bTopology=Circle, Num Agents=62025.12 | 16.99 | |
| DeepSeek-v3.1Topology=Complete, Num Agents=52025.12 | 16.99 | |
| Llama3.1-70bTopology=Tree, Num Agents=42025.12 | 17.67 | |
| Llama3.1-70bTopology=Circle, Num Agents=52025.12 | 17.95 | |
| DeepSeek-v3.1Topology=Complete, Num Agents=62025.12 | 18.37 | |
| Llama3.1-70bTopology=Chain, Num Agents=42025.12 | 19.02 | |
| Llama3.1-70bTopology=Star-Ring, Num Agents=52025.12 | 20.67 | |
| Llama3.1-70bTopology=Star-Pure, Num Agents=52025.12 | 22.44 | |
| Llama3.1-70bTopology=Star-Pure, Num Agents=62025.12 | 23.08 | |
| Llama3.1-70bTopology=Star-Ring, Num Agents=62025.12 | 23.16 | |
| Llama3.1-70bTopology=Star-Pure, Num Agents=42025.12 | 23.93 | |
| Llama3.1-70bTopology=Circle, Num Agents=42025.12 | 24.2 | |
| Llama3.1-70bTopology=Complete, Num Agents=62025.12 | 25.32 | |
| Llama3.1-70bTopology=Star-Ring, Num Agents=42025.12 | 25.53 | |
| Llama3.1-70bTopology=Complete, Num Agents=52025.12 | 29.01 | |
| Llama3.1-70bTopology=Complete, Num Agents=42025.12 | 29.33 |