List your company
ResearchFormerly WizWand

Membership Inference Attack on HackerNews Pythia

0.72ROC AUCAttenMIA (Perturbed)
0.47040.53520.60.6648Jan 26, 2026
Updated 8mo ago

Evaluation results

MethodLinks
AttenMIA (Perturbed)Model size=2.8b2026.010.72
AttenMIA (Perturbed)Model size=6.9b2026.010.72
AttenMIA (Perturbed)Model size=1.4b2026.010.7
AttenMIA (Transitional)Model size=1.4b2026.010.62
PPL attackModel size=2.8b2026.010.6
PPL attackModel size=6.9b2026.010.6
zlib attackModel size=2.8b2026.010.6
PPL attackModel size=1.4b2026.010.59
zlib attackModel size=1.4b2026.010.59
zlib attackModel size=6.9b2026.010.59
MIN-K% PROBModel size=6.9b2026.010.59
PETALModel size=1.4b2026.010.59
AttenMIA (Transitional)Model size=2.8b2026.010.59
AttenMIA (Transitional)Model size=6.9b2026.010.59
MIN-K% PROBModel size=2.8b2026.010.58
PETALModel size=2.8b2026.010.58
PETALModel size=6.9b2026.010.58
MIN-K% PROBModel size=1.4b2026.010.57
neighborhood attackModel size=2.8b2026.010.55
neighborhood attackModel size=6.9b2026.010.54
RECALLModel size=6.9b2026.010.54
reference attackModel size=2.8b2026.010.53
neighborhood attackModel size=1.4b2026.010.53
BT attackModel size=6.9b2026.010.53
RECALLModel size=1.4b2026.010.53
RECALLModel size=2.8b2026.010.53
reference attackModel size=1.4b2026.010.52
reference attackModel size=6.9b2026.010.52
BT attackModel size=2.8b2026.010.52
WS attackModel size=1.4b2026.010.51
WS attackModel size=2.8b2026.010.51
RS attackModel size=2.8b2026.010.51
RS attackModel size=6.9b2026.010.51
BT attackModel size=1.4b2026.010.51
RS attackModel size=1.4b2026.010.49
WS attackModel size=6.9b2026.010.48