# Membership Inference on Enron (canary-audit) Source: [Membership Inference on Enron (canary-audit)]() Collection index: [llms.txt]() Data updated: 2026-06-11T07:55:24.500Z Evaluation of model susceptibility to Membership Inference attacks on the specific canary-audit subset of the Enron dataset, measured using metrics like mu and TPR at specific FPR levels (1% and 10%). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Membership Inference | | Dataset (including any stated split) | Enron (canary-audit) | | Metric | Mu | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Mu](): Higher is better; unit: SCALAR. - [TPR @ 1% FPR](): Higher is better; unit: PERCENT. - [TPR @ 10% FPR](): Higher is better; unit: PERCENT. ## Recorded results | Method | Mu | Result date | Report paper | | --- | --- | --- | --- | | LLM | 2.519 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 2.501 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 2.41 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 2.229 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 2.21 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 2.037 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 1.869 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 1.448 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.699 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.609 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.568 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.482 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.39 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.364 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.307 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.266 | Not recorded | 6a28f32690966ade919c1687 | | LLM | 0.26 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.231 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.225 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.213 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.206 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.2 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.194 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.183 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.162 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.161 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.146 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.142 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.133 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.109 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.107 | Not recorded | 6a28f32690966ade919c1687 | | Bigram | 0.104 | Not recorded | 6a28f32690966ade919c1687 | ### LLM Mu: 2.519. Result ID: 6a2a6881fbc373592c2740bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 3.0","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 2.501. Result ID: 6a2a6881fbc373592c2740bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 2.0","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 2.41. Result ID: 6a2a6881fbc373592c2740bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 2.5","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 2.229. Result ID: 6a2a6881fbc373592c2740b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 1.0","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 2.21. Result ID: 6a2a6881fbc373592c2740b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 1.5","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 2.037. Result ID: 6a2a6881fbc373592c2740b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"PERP","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 1.869. Result ID: 6a2a6881fbc373592c2740b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 0.8","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 1.448. Result ID: 6a2a6881fbc373592c2740c1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"ENRON","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.699. Result ID: 6a2a6881fbc373592c2740c7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 0.8","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.609. Result ID: 6a2a6881fbc373592c2740c3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"RANDOM","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.568. Result ID: 6a2a6881fbc373592c2740cb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 1.5","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.482. Result ID: 6a2a6881fbc373592c2740c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 1.0","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.39. Result ID: 6a2a6881fbc373592c2740c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"PERP","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.364. Result ID: 6a2a6881fbc373592c2740cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 2.0","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.307. Result ID: 6a2a6881fbc373592c2740cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 2.5","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.266. Result ID: 6a2a6881fbc373592c2740b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"PERP","RMIA":"false"}. This record does not assert independent reproduction. ### LLM Mu: 0.26. Result ID: 6a2a6881fbc373592c2740d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 3.0","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.231. Result ID: 6a2a6881fbc373592c2740b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 1.0","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.225. Result ID: 6a2a6881fbc373592c2740c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"ENRON","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.213. Result ID: 6a2a6881fbc373592c2740c4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"PERP","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.206. Result ID: 6a2a6881fbc373592c2740c8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 1.0","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.2. Result ID: 6a2a6881fbc373592c2740c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"RANDOM","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.194. Result ID: 6a2a6881fbc373592c2740d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 3.0","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.183. Result ID: 6a2a6881fbc373592c2740be. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 3.0","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.162. Result ID: 6a2a6881fbc373592c2740cc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 2.0","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.161. Result ID: 6a2a6881fbc373592c2740ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 2.0","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.146. Result ID: 6a2a6881fbc373592c2740bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 2.5","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.142. Result ID: 6a2a6881fbc373592c2740ce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 2.5","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.133. Result ID: 6a2a6881fbc373592c2740b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 0.8","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.109. Result ID: 6a2a6881fbc373592c2740b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"10","Canary Type":"T = 1.5","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.107. Result ID: 6a2a6881fbc373592c2740ca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 1.5","RMIA":"false"}. This record does not assert independent reproduction. ### Bigram Mu: 0.104. Result ID: 6a2a6881fbc373592c2740c6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reps":"3","Canary Type":"T = 0.8","RMIA":"false"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.