List your company
ResearchFormerly WizWand

Membership Inference on Wikipedia Pythia (train)

22.7TPR@1%FPRAttenMIA (Perturbed)
-0.4925.52911.5517.571Jan 26, 2026
Updated 8mo ago

Evaluation results

MethodLinks
AttenMIA (Perturbed)Model Size=1.4b2026.0122.7
AttenMIA (Perturbed)Model Size=6.9b2026.0120.7
AttenMIA (Perturbed)Model Size=2.8b2026.0120
AttenMIA (Transitional)Model Size=1.4b2026.0116.7
RECALLModel Size=6.9b2026.0113.6
RECALLModel Size=2.8b2026.0111.7
RECALLModel Size=1.4b2026.0110.7
AttenMIA (Transitional)Model Size=6.9b2026.017.7
AttenMIA (Transitional)Model Size=2.8b2026.017.6
BT attackModel Size=1.4b2026.016
PPL attackModel Size=1.4b2026.014.8
WS attackModel Size=6.9b2026.014.4
PPL attackModel Size=2.8b2026.014
PETALModel Size=6.9b2026.014
reference attackModel Size=1.4b2026.013.6
RS attackModel Size=6.9b2026.013.6
BT attackModel Size=6.9b2026.013.6
PPL attackModel Size=6.9b2026.013.2
RS attackModel Size=1.4b2026.013.2
PETALModel Size=1.4b2026.013.2
WS attackModel Size=1.4b2026.012.8
BT attackModel Size=2.8b2026.012.8
PETALModel Size=2.8b2026.012.8
zlib attackModel Size=2.8b2026.012.4
zlib attackModel Size=6.9b2026.012.4
zlib attackModel Size=1.4b2026.012
MIN-K% PROBModel Size=1.4b2026.012
MIN-K% PROBModel Size=6.9b2026.012
RS attackModel Size=2.8b2026.012
reference attackModel Size=6.9b2026.011.6
WS attackModel Size=2.8b2026.011.6
neighborhood attackModel Size=6.9b2026.011.2
reference attackModel Size=2.8b2026.010.8
neighborhood attackModel Size=2.8b2026.010.8
neighborhood attackModel Size=1.4b2026.010.4
MIN-K% PROBModel Size=2.8b2026.010.4