Membership Inference on Enron (canary-audit)
2.519MuLLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LLMReps=10, Canary Type=T = 3.0, RMIA=false2026.06 | 2.519 | 24.34 | 52.9 | |
| LLMReps=10, Canary Type=T = 2.0, RMIA=false2026.06 | 2.501 | 32.7 | 64.5 | |
| LLMReps=10, Canary Type=T = 2.5, RMIA=false2026.06 | 2.41 | 28.39 | 58 | |
| LLMReps=10, Canary Type=T = 1.0, RMIA=false2026.06 | 2.229 | 17.97 | 44.3 | |
| LLMReps=10, Canary Type=T = 1.5, RMIA=false2026.06 | 2.21 | 20.76 | 48.6 | |
| LLMReps=10, Canary Type=PERP, RMIA=false2026.06 | 2.037 | 17.23 | 39.4 | |
| LLMReps=10, Canary Type=T = 0.8, RMIA=false2026.06 | 1.869 | 17.17 | 40.2 | |
| LLMReps=10, Canary Type=ENRON, RMIA=false2026.06 | 1.448 | 12.32 | 31.5 | |
| LLMReps=3, Canary Type=T = 0.8, RMIA=false2026.06 | 0.699 | 2.8 | 16.6 | |
| LLMReps=10, Canary Type=RANDOM, RMIA=false2026.06 | 0.609 | 2.42 | 17.1 | |
| LLMReps=3, Canary Type=T = 1.5, RMIA=false2026.06 | 0.568 | 2.68 | 17.4 | |
| LLMReps=3, Canary Type=T = 1.0, RMIA=false2026.06 | 0.482 | 2.78 | 17.4 | |
| LLMReps=3, Canary Type=PERP, RMIA=false2026.06 | 0.39 | 2.06 | 16 | |
| LLMReps=3, Canary Type=T = 2.0, RMIA=false2026.06 | 0.364 | 2.39 | 14.3 | |
| LLMReps=3, Canary Type=T = 2.5, RMIA=false2026.06 | 0.307 | 1.79 | 13.1 | |
| BigramReps=10, Canary Type=PERP, RMIA=false2026.06 | 0.266 | 1.83 | 13.7 | |
| LLMReps=3, Canary Type=T = 3.0, RMIA=false2026.06 | 0.26 | 1.83 | 13.1 | |
| BigramReps=10, Canary Type=T = 1.0, RMIA=false2026.06 | 0.231 | 1.44 | 11.6 | |
| BigramReps=10, Canary Type=ENRON, RMIA=false2026.06 | 0.225 | 1.39 | 10.6 | |
| BigramReps=3, Canary Type=PERP, RMIA=false2026.06 | 0.213 | 1.55 | 13 | |
| BigramReps=3, Canary Type=T = 1.0, RMIA=false2026.06 | 0.206 | 1.18 | 11.2 | |
| BigramReps=10, Canary Type=RANDOM, RMIA=false2026.06 | 0.2 | 1.34 | 10.9 | |
| BigramReps=3, Canary Type=T = 3.0, RMIA=false2026.06 | 0.194 | 1.41 | 10.7 | |
| BigramReps=10, Canary Type=T = 3.0, RMIA=false2026.06 | 0.183 | 1.46 | 10.7 | |
| BigramReps=3, Canary Type=T = 2.0, RMIA=false2026.06 | 0.162 | 1.5 | 11 | |
| BigramReps=10, Canary Type=T = 2.0, RMIA=false2026.06 | 0.161 | 1.49 | 11.2 | |
| BigramReps=10, Canary Type=T = 2.5, RMIA=false2026.06 | 0.146 | 1.27 | 10.8 | |
| BigramReps=3, Canary Type=T = 2.5, RMIA=false2026.06 | 0.142 | 1.24 | 10.5 | |
| BigramReps=10, Canary Type=T = 0.8, RMIA=false2026.06 | 0.133 | 1.16 | 10.5 | |
| BigramReps=10, Canary Type=T = 1.5, RMIA=false2026.06 | 0.109 | 1.26 | 10.8 | |
| BigramReps=3, Canary Type=T = 1.5, RMIA=false2026.06 | 0.107 | 1.3 | 11.1 | |
| BigramReps=3, Canary Type=T = 0.8, RMIA=false2026.06 | 0.104 | 1.09 | 10.4 |