Membership Inference Attack Ranking on Synthetic Data Release (1,525 runs)
46.2Top-1 Success RateGen LRA k = 10
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gen LRA k = 10Ranking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 46.2 | 76.7 | 2.54 | |
| Gen LRA k = 10Ranking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 42.1 | 78.5 | 2.79 | |
| Gen LRA k = 10Ranking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 41.5 | 75.6 | 2.76 | |
| Gen LRA k = 10Ranking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 39.8 | 73.1 | 2.78 | |
| Gen LRA k = 10Ranking Metric Source=AUC2025.08 | 38.6 | 71.7 | 2.83 | |
| DCR-DiffRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 18.4 | 60.3 | 3.78 | |
| DCRRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 17.4 | 44.1 | 4.67 | |
| DCR-DiffRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 16.4 | 51.8 | 4.05 | |
| DCR-DiffRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 16.3 | 50 | 4.2 | |
| DCR-DiffRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 16.3 | 46.2 | 4.2 | |
| LOGANRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 16.2 | 48.9 | 4.35 | |
| ClassifierRanking Metric Source=AUC2025.08 | 16 | 45.7 | 4.29 | |
| DCRRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 15 | 37.4 | 4.77 | |
| LOGANRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 13.8 | 41.7 | 4.71 | |
| DOMIASRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 12.7 | 52.1 | 4.22 | |
| LOGANRanking Metric Source=AUC2025.08 | 12.7 | 28.7 | 5.51 | |
| MCRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 12.5 | 43.8 | 4.71 | |
| DCRRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 12.2 | 37.9 | 4.63 | |
| DCR-DiffRanking Metric Source=AUC2025.08 | 12 | 43.5 | 4.11 | |
| DOMIASRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 11.8 | 43.4 | 4.56 | |
| DOMIASRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 11.8 | 41 | 4.63 | |
| ClassifierRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 11.6 | 35.2 | 4.79 | |
| DOMIASRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 11.3 | 36.8 | 5.03 | |
| LOGANRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 11.3 | 30.8 | 5.3 | |
| MCRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 11.3 | 35.7 | 4.91 | |
| LOGANRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 11 | 32.1 | 5.19 | |
| DPIRanking Metric Source=AUC2025.08 | 10.7 | 38.9 | 4.5 | |
| DOMIASRanking Metric Source=AUC2025.08 | 10 | 36.8 | 4.42 | |
| ClassifierRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 9.6 | 35.4 | 5.22 | |
| ClassifierRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 9.6 | 35.7 | 4.83 | |
| ClassifierRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 9.1 | 31.9 | 5.04 | |
| DCRRanking Metric Source=AUC2025.08 | 9 | 31.2 | 4.93 | |
| MCRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 8.5 | 30.3 | 5.11 | |
| DCRRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 8.3 | 32.2 | 4.86 | |
| Local NeighborhoodRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 6.7 | 29.9 | 5.11 | |
| Local NeighborhoodRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 6.6 | 32.9 | 5.4 | |
| DPIRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 6.5 | 29.9 | 4.97 | |
| MCRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 6.3 | 25.3 | 5.32 | |
| Local NeighborhoodRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 5.8 | 30.3 | 5.26 | |
| Local NeighborhoodRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.12025.08 | 4.4 | 20.8 | 5.41 | |
| MCRanking Metric Source=AUC2025.08 | 4.2 | 22.5 | 5.61 | |
| DPIRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.012025.08 | 4 | 20.6 | 5.18 | |
| DPIRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.02025.08 | 2.4 | 13 | 6.79 | |
| Local NeighborhoodRanking Metric Source=AUC2025.08 | 2.4 | 16 | 5.79 | |
| DPIRanking Metric Source=TPR at Fixed FPR, FPR threshold=0.0012025.08 | 1.9 | 12.4 | 5.94 |