# Membership Inference Attack on Llama-13B Source: [Membership Inference Attack on Llama-13B]() Collection index: [llms.txt]() Data updated: 2026-07-01T08:42:47.017Z Evaluation of Membership Inference Attack performance on the Llama-13B model/dataset, reporting metrics such as TPR@1%FPR and AUC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Membership Inference Attack | | Dataset (including any stated split) | Llama-13B | | Metric | TPR@1%FPR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [TPR@1%FPR](): Higher is better; unit: PERCENT. - [AUC](): Higher is better; unit: PERCENT. ## Recorded results | Method | TPR@1%FPR | Result date | Report paper | | --- | --- | --- | --- | | Zlib + Quality | 21 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Quality | 19.8 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Combined | 19.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Quality | 19.2 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Combined | 18.8 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Combined | 18.2 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Quality | 17.8 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Diversity | 17.6 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Combined | 17.6 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Diversity | 17.3 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA | 16.6 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Diversity | 14.6 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Diversity | 14.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% | 12.7 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss | 0.9 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib | 0.9 | Not recorded | 6a449f0ae0224bd4f4993046 | ### Zlib + Quality TPR@1%FPR: 21. Result ID: 6a44d30473d097d845bfa727. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Quality TPR@1%FPR: 19.8. Result ID: 6a44d30473d097d845bfa723. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Combined TPR@1%FPR: 19.4. Result ID: 6a44d30473d097d845bfa728. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Quality TPR@1%FPR: 19.2. Result ID: 6a44d30573d097d845bfa72f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Combined TPR@1%FPR: 18.8. Result ID: 6a44d30473d097d845bfa724. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Combined TPR@1%FPR: 18.2. Result ID: 6a44d30473d097d845bfa72c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Quality TPR@1%FPR: 17.8. Result ID: 6a44d30473d097d845bfa72b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Diversity TPR@1%FPR: 17.6. Result ID: 6a44d30473d097d845bfa726. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Combined TPR@1%FPR: 17.6. Result ID: 6a44d30573d097d845bfa730. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Diversity TPR@1%FPR: 17.3. Result ID: 6a44d30473d097d845bfa722. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA TPR@1%FPR: 16.6. Result ID: 6a44d30473d097d845bfa72d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Diversity TPR@1%FPR: 14.6. Result ID: 6a44d30473d097d845bfa72e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Diversity TPR@1%FPR: 14.4. Result ID: 6a44d30473d097d845bfa72a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% TPR@1%FPR: 12.7. Result ID: 6a44d30473d097d845bfa729. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### Loss TPR@1%FPR: 0.9. Result ID: 6a44d30473d097d845bfa721. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib TPR@1%FPR: 0.9. Result ID: 6a44d30473d097d845bfa725. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.