# Membership Inference Attack on CIFAR10 (Balanced Accuracy and TPR@0.1%FPR)

Source: [Membership Inference Attack on CIFAR10 (Balanced Accuracy and TPR@0.1%FPR)](<https://www.sota2.com/research/sota/membership-inference-attack-on-cifar10-balanced-accuracy-and-tpr-at-0-1-percent-fpr>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-07T07:48:21.389Z

Evaluation of a model's susceptibility to Membership Inference Attacks on the CIFAR-10 dataset, reporting both Balanced Accuracy and the True Positive Rate at 0.1% False Positive Rate.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Membership Inference Attack |
| Dataset (including any stated split) | CIFAR10 |
| Metric | TPR @ 0.1% FPR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 28 of 28 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [TPR @ 0.1% FPR](<https://www.sota2.com/research/sota/membership-inference-attack-on-cifar10-balanced-accuracy-and-tpr-at-0-1-percent-fpr.md?metric=TPR%20%40%200.1%25%20FPR>): Higher is better; unit: PERCENT.

- [Balanced Accuracy](<https://www.sota2.com/research/sota/membership-inference-attack-on-cifar10-balanced-accuracy-and-tpr-at-0-1-percent-fpr.md?metric=Balanced%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | TPR @ 0.1% FPR | Result date | Report paper |
| --- | --- | --- | --- |
| LIME | 70 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| LIME | 60 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| IG | 40 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM | 30 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| VarGrad | 20 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM++ | 20 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SHAP | 20 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| VarGrad | 20 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| VarGrad | 20 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM++ | 20 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SmoothGrad | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| IG | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| LIME | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SmoothGrad | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SHAP | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SmoothGrad | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| VarGrad | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM++ | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| IG | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SHAP | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| LIME | 10 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SmoothGrad | 0 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM++ | 0 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| IG | 0 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| SHAP | 0 | Not recorded | 6a4c87fc85dba69fef8b25cc |
| GradCAM | 0 | Not recorded | 6a4c87fc85dba69fef8b25cc |

### LIME

TPR @ 0.1% FPR: 70. Result ID: 6a4caf2a60b88bb339c7d877.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"None","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### LIME

TPR @ 0.1% FPR: 60. Result ID: 6a4caf2a60b88bb339c7d885.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"Memguard","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### IG

TPR @ 0.1% FPR: 40. Result ID: 6a4caf2a60b88bb339c7d883.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"Memguard","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM

TPR @ 0.1% FPR: 30. Result ID: 6a4caf2a60b88bb339c7d881.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"Memguard","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### VarGrad

TPR @ 0.1% FPR: 20. Result ID: 6a4caf2a60b88bb339c7d872.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"None","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM++

TPR @ 0.1% FPR: 20. Result ID: 6a4caf2a60b88bb339c7d874.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"None","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SHAP

TPR @ 0.1% FPR: 20. Result ID: 6a4caf2a60b88bb339c7d876.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"None","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### VarGrad

TPR @ 0.1% FPR: 20. Result ID: 6a4caf2a60b88bb339c7d879.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"DP (ϵ = 100)","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### VarGrad

TPR @ 0.1% FPR: 20. Result ID: 6a4caf2a60b88bb339c7d880.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"Memguard","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM++

TPR @ 0.1% FPR: 20. Result ID: 6a4caf2a60b88bb339c7d882.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"Memguard","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SmoothGrad

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d871.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"None","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d873.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"None","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### IG

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d875.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"None","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d87a.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"DP (ϵ = 100)","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### LIME

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d87e.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"DP (ϵ = 100)","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SmoothGrad

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d87f.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"Memguard","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SHAP

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d884.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"Memguard","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SmoothGrad

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d886.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"TIER","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### VarGrad

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d887.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"TIER","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM++

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d889.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"TIER","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### IG

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d88a.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"TIER","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SHAP

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d88b.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"TIER","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### LIME

TPR @ 0.1% FPR: 10. Result ID: 6a4caf2a60b88bb339c7d88c.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"TIER","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SmoothGrad

TPR @ 0.1% FPR: 0. Result ID: 6a4caf2a60b88bb339c7d878.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"DP (ϵ = 100)","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM++

TPR @ 0.1% FPR: 0. Result ID: 6a4caf2a60b88bb339c7d87b.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"DP (ϵ = 100)","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### IG

TPR @ 0.1% FPR: 0. Result ID: 6a4caf2a60b88bb339c7d87c.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"DP (ϵ = 100)","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### SHAP

TPR @ 0.1% FPR: 0. Result ID: 6a4caf2a60b88bb339c7d87d.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"DP (ϵ = 100)","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

### GradCAM

TPR @ 0.1% FPR: 0. Result ID: 6a4caf2a60b88bb339c7d888.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87fc85dba69fef8b25cc.md>)

Recorded evaluation configuration: {"Defense":"TIER","Backbone":"ResNet-18"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
