# Privacy Auditing on CIFAR10 (test) Source: [Privacy Auditing on CIFAR10 (test)]() Collection index: [llms.txt]() Data updated: 2026-05-27T10:21:12.028Z Evaluation of privacy auditing metrics (Mean, Std, Median) performed on models evaluated using the test split of the CIFAR-10 dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Privacy Auditing | | Dataset (including any stated split) | CIFAR10 (test) | | Metric | Mean | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Mean](): Lower is better; unit: PERCENT. - [Std Dev](): Lower is better; unit: PERCENT. - [Median](): Lower is better; unit: PERCENT. ## Recorded results | Method | Mean | Result date | Report paper | | --- | --- | --- | --- | | Random | 3 | Not recorded | 6a167ad8dbd7150506f802ec | | Random + Flip | 5 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 8 | Not recorded | 6a167ad8dbd7150506f802ec | | Boglioni et al. | 11 | Not recorded | 6a167ad8dbd7150506f802ec | | Random | 12 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 12 | Not recorded | 6a167ad8dbd7150506f802ec | | Random + Flip | 18 | Not recorded | 6a167ad8dbd7150506f802ec | | Random | 19 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 19 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 21 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 21 | Not recorded | 6a167ad8dbd7150506f802ec | | Random | 22 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 23 | Not recorded | 6a167ad8dbd7150506f802ec | | Random + Flip | 24 | Not recorded | 6a167ad8dbd7150506f802ec | | Random + Flip | 24 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 25 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 25 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 27 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 27 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 34 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS no reg. | 38 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 40 | Not recorded | 6a167ad8dbd7150506f802ec | | Boglioni et al. | 40 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 45 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 50 | Not recorded | 6a167ad8dbd7150506f802ec | | Boglioni et al. | 55 | Not recorded | 6a167ad8dbd7150506f802ec | | IBIS reg. | 59 | Not recorded | 6a167ad8dbd7150506f802ec | | Boglioni et al. | 60 | Not recorded | 6a167ad8dbd7150506f802ec | ### Random Mean: 3. Result ID: 6a16c4aafbc373592c108732. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"1","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### Random + Flip Mean: 5. Result ID: 6a16c4aafbc373592c10872c. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"2","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 8. Result ID: 6a16c4aafbc373592c10872e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"1","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### Boglioni et al. Mean: 11. Result ID: 6a16c4aafbc373592c108731. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"1","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### Random Mean: 12. Result ID: 6a16c4aafbc373592c10872b. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"2","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 12. Result ID: 6a16c4aafbc373592c108730. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"1","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### Random + Flip Mean: 18. Result ID: 6a16c4aafbc373592c108733. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"1","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### Random Mean: 19. Result ID: 6a16c4aafbc373592c108724. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"4","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 19. Result ID: 6a16c4aafbc373592c108729. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"2","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 21. Result ID: 6a16c4aafbc373592c108726. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"2","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 21. Result ID: 6a16c4aafbc373592c10872f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"1","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### Random Mean: 22. Result ID: 6a16c4aafbc373592c10871d. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"10","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 23. Result ID: 6a16c4aafbc373592c108718. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"10","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### Random + Flip Mean: 24. Result ID: 6a16c4aafbc373592c10871e. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"10","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### Random + Flip Mean: 24. Result ID: 6a16c4aafbc373592c108725. [Reporting paper]() Recorded evaluation configuration: {"Target Epsilon":"4","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 25. Result ID: 6a16c4aafbc373592c108719. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"10","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 25. Result ID: 6a16c4aafbc373592c108728. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"2","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 27. Result ID: 6a16c4aafbc373592c108727. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"2","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 27. Result ID: 6a16c4aafbc373592c10872d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"1","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 34. Result ID: 6a16c4aafbc373592c10871f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"4","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS no reg. Mean: 38. Result ID: 6a16c4aafbc373592c108720. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"4","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 40. Result ID: 6a16c4aafbc373592c108721. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"4","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### Boglioni et al. Mean: 40. Result ID: 6a16c4aafbc373592c10872a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"2","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 45. Result ID: 6a16c4aafbc373592c10871a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"10","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 50. Result ID: 6a16c4aafbc373592c10871b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"10","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### Boglioni et al. Mean: 55. Result ID: 6a16c4aafbc373592c108723. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"4","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. ### IBIS reg. Mean: 59. Result ID: 6a16c4aafbc373592c108722. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"4","Crafting Architecture":"CNN"}. This record does not assert independent reproduction. ### Boglioni et al. Mean: 60. Result ID: 6a16c4aafbc373592c10871c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target Epsilon":"10","Crafting Architecture":"ResNet9"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.