# Membership Inference Attack on Pythia 6.9B Source: [Membership Inference Attack on Pythia 6.9B]() Collection index: [llms.txt]() Data updated: 2026-07-01T08:42:46.935Z Evaluation of Membership Inference Attack performance on the Pythia 6.9B dataset or model configuration, measured by metrics such as TPR@1%FPR and AUC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Membership Inference Attack | | Dataset (including any stated split) | Pythia 6.9B | | Metric | TPR@1%FPR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [TPR@1%FPR](): Higher is better; unit: PERCENT. - [AUC](): Higher is better; unit: PERCENT. ## Recorded results | Method | TPR@1%FPR | Result date | Report paper | | --- | --- | --- | --- | | CAMIA + Quality | 13.1 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Diversity | 12.9 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Combined | 12.8 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Quality | 12.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% | 12.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Quality | 12.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Diversity | 12 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Diversity | 11.8 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Combined | 11.3 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA | 11.1 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Combined | 10.9 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Combined | 10 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Quality | 9.6 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Diversity | 9.3 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss | 0.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib | 0 | Not recorded | 6a449f0ae0224bd4f4993046 | ### CAMIA + Quality TPR@1%FPR: 13.1. Result ID: 6a44d30473d097d845bfa6ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Diversity TPR@1%FPR: 12.9. Result ID: 6a44d30473d097d845bfa6f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Combined TPR@1%FPR: 12.8. Result ID: 6a44d30473d097d845bfa6f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Quality TPR@1%FPR: 12.4. Result ID: 6a44d30473d097d845bfa6f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% TPR@1%FPR: 12.4. Result ID: 6a44d30473d097d845bfa6f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Quality TPR@1%FPR: 12.4. Result ID: 6a44d30473d097d845bfa6fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Diversity TPR@1%FPR: 12. Result ID: 6a44d30473d097d845bfa6fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Diversity TPR@1%FPR: 11.8. Result ID: 6a44d30473d097d845bfa6fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Combined TPR@1%FPR: 11.3. Result ID: 6a44d30473d097d845bfa6fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA TPR@1%FPR: 11.1. Result ID: 6a44d30473d097d845bfa6fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Combined TPR@1%FPR: 10.9. Result ID: 6a44d30473d097d845bfa700. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Combined TPR@1%FPR: 10. Result ID: 6a44d30473d097d845bfa6f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Quality TPR@1%FPR: 9.6. Result ID: 6a44d30473d097d845bfa6f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Diversity TPR@1%FPR: 9.3. Result ID: 6a44d30473d097d845bfa6f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Loss TPR@1%FPR: 0.4. Result ID: 6a44d30473d097d845bfa6f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib TPR@1%FPR: 0. Result ID: 6a44d30473d097d845bfa6f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.