Membership Inference Attack on Reddit
0.836AUCWBC
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| WBC2026.01 | 0.836 | 0.463 | 0.067 | 0.002 | — | |
| SPV-MIA2026.01 | 0.758 | 0.368 | 0.062 | 0.002 | — | |
| Ensemble2026.01 | 0.74 | 0.288 | 0.053 | 0 | — | |
| Difference2026.01 | 0.708 | 0.16 | 0.013 | 0.002 | — | |
| Ratio2026.01 | 0.7 | 0.148 | 0.013 | 0.002 | — | |
| DC-PDD2026.01 | 0.52 | 0.106 | 0.011 | 0.001 | — | |
| Min-K%++2026.01 | 0.519 | 0.108 | 0.011 | 0.001 | — | |
| Min-K%2026.01 | 0.518 | 0.108 | 0.012 | 0.001 | — | |
| ZLIB2026.01 | 0.514 | 0.11 | 0.013 | 0.001 | — | |
| Lowercase2026.01 | 0.514 | 0.106 | 0.015 | 0.002 | — | |
| Loss2026.01 | 0.51 | 0.109 | 0.014 | 0.001 | — | |
| ReCall2026.01 | 0.51 | 0.109 | 0.014 | 0.001 | — | |
| CON-Recall2026.01 | 0.51 | 0.105 | 0.013 | 0.001 | — | |
| BoWs2026.01 | 0.496 | 0.096 | 0.009 | 0 | — | |
| LLM-DIModel=410m2026.03 | — | — | — | — | 0.437 | |
| LLM-DIModel=410m-CPT2026.03 | — | — | — | — | 0.064 | |
| PaCoSTModel=410m2026.03 | — | — | — | — | 0.001 | |
| PaCoSTModel=410m-CPT2026.03 | — | — | — | — | 0 | |
| PRISMTarget Model=Pythia-410m-CPT, Reference Model=Pythia-1b2026.03 | — | — | — | — | 0.817 | |
| PRISMTarget Model=Pythia-410m, Reference Model=Pythia-1b2026.03 | — | — | — | — | 0.0001 | |
| PRISMTarget Model=Pythia-1b, Reference Model=Pythia-410m2026.03 | — | — | — | — | 0.0001 | |
| PRISMTarget Model=Pythia-2.8b, Reference Model=Pythia-410m2026.03 | — | — | — | — | 0.0001 | |
| PRISMTarget Model=Pythia-6.9b, Reference Model=Pythia-410m2026.03 | — | — | — | — | 0.0001 |