# Membership Inference Attack on OPT-6.7B Source: [Membership Inference Attack on OPT-6.7B]() Collection index: [llms.txt]() Data updated: 2026-07-01T08:42:46.989Z Evaluation of a model's susceptibility to Membership Inference Attacks on the OPT-6.7B dataset, reporting metrics such as TPR@1%FPR and AUC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Membership Inference Attack | | Dataset (including any stated split) | OPT-6.7B | | Metric | TPR @ 1% FPR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [TPR @ 1% FPR](): Higher is better; unit: PERCENT. - [AUC](): Higher is better; unit: SCALAR. ## Recorded results | Method | TPR @ 1% FPR | Result date | Report paper | | --- | --- | --- | --- | | CAMIA | 12.8 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Combined | 12.1 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Quality | 11.5 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Combined | 11.2 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Combined | 10.9 | Not recorded | 6a449f0ae0224bd4f4993046 | | CAMIA + Diversity | 10.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Diversity | 9.9 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Quality | 9.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Diversity | 9.2 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib + Quality | 9.2 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Combined | 9.2 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% | 8.6 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss + Quality | 8.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Min-K% + Diversity | 6.4 | Not recorded | 6a449f0ae0224bd4f4993046 | | Loss | 1.3 | Not recorded | 6a449f0ae0224bd4f4993046 | | Zlib | 1.2 | Not recorded | 6a449f0ae0224bd4f4993046 | ### CAMIA TPR @ 1% FPR: 12.8. Result ID: 6a44d30473d097d845bfa71d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Combined TPR @ 1% FPR: 12.1. Result ID: 6a44d30473d097d845bfa718. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Quality TPR @ 1% FPR: 11.5. Result ID: 6a44d30473d097d845bfa71f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Combined TPR @ 1% FPR: 11.2. Result ID: 6a44d30473d097d845bfa714. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Combined TPR @ 1% FPR: 10.9. Result ID: 6a44d30473d097d845bfa720. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### CAMIA + Diversity TPR @ 1% FPR: 10.4. Result ID: 6a44d30473d097d845bfa71e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"CAMIA","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Diversity TPR @ 1% FPR: 9.9. Result ID: 6a44d30473d097d845bfa716. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Quality TPR @ 1% FPR: 9.4. Result ID: 6a44d30473d097d845bfa71b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Diversity TPR @ 1% FPR: 9.2. Result ID: 6a44d30473d097d845bfa712. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib + Quality TPR @ 1% FPR: 9.2. Result ID: 6a44d30473d097d845bfa717. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Combined TPR @ 1% FPR: 9.2. Result ID: 6a44d30473d097d845bfa71c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Combined","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% TPR @ 1% FPR: 8.6. Result ID: 6a44d30473d097d845bfa719. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### Loss + Quality TPR @ 1% FPR: 8.4. Result ID: 6a44d30473d097d845bfa713. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"Quality","Iterations":"15"}. This record does not assert independent reproduction. ### Min-K% + Diversity TPR @ 1% FPR: 6.4. Result ID: 6a44d30473d097d845bfa71a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Min-K%","Augmentation":"Diversity","Iterations":"15"}. This record does not assert independent reproduction. ### Loss TPR @ 1% FPR: 1.3. Result ID: 6a44d30473d097d845bfa711. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Loss","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. ### Zlib TPR @ 1% FPR: 1.2. Result ID: 6a44d30473d097d845bfa715. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Attack":"Zlib","Augmentation":"None","Iterations":"15"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.