Membership Inference Attack on Reddit (test)
78.5AUC (PPL)AUG-PE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AUG-PEModel=GPT-4o-mini2026.04 | 78.5 | 21.9 | 68.5 | |
| AUG-PEModel=Phi-42026.04 | 74.9 | 31.3 | 59.1 | |
| RPSGModel=GPT-22026.04 | 54.3 | 59.1 | 44.3 | |
| RPSGModel=Phi-42026.04 | 54.1 | 50.9 | 50 | |
| RPSGModel=DistilGPT22026.04 | 54 | 58.4 | 45.2 | |
| RPSGModel=GPT-3.52026.04 | 53.9 | 56.2 | 44.8 | |
| RPSGModel=GPT-4o-mini2026.04 | 52.1 | 59.3 | 43.7 | |
| RPSGModel=DeepSeek-R12026.04 | 52.1 | 58.2 | 45.6 | |
| AUG-PEModel=GPT-3.52026.04 | 48.4 | 60.3 | 43.2 | |
| DP-SGDModel=DistilGPT22026.04 | 44.3 | 54.1 | 50.4 | |
| AUG-PEModel=DeepSeek-R12026.04 | 36.1 | 70.1 | 40.5 | |
| DP-SGDModel=GPT-22026.04 | 31.6 | 38.7 | 56.9 |