List your company
ResearchFormerly WizWand

Membership Inference on GitHub Pythia (train)

95.6TPR@1%FPRAttenMIA (Perturbed)
6.1629.3852.675.82Jan 26, 2026
Updated 8mo ago

Evaluation results

MethodLinks
AttenMIA (Perturbed)Model Size=2.8b2026.0195.6
AttenMIA (Perturbed)Model Size=6.9b2026.0195.4
AttenMIA (Perturbed)Model Size=1.4b2026.0191.3
AttenMIA (Transitional)Model Size=2.8b2026.0173.8
AttenMIA (Transitional)Model Size=1.4b2026.0160.7
AttenMIA (Transitional)Model Size=6.9b2026.0160.1
RECALLModel Size=6.9b2026.0152.7
RECALLModel Size=2.8b2026.0149.6
PPL attackModel Size=6.9b2026.0148.8
RECALLModel Size=1.4b2026.0148.8
PETALModel Size=6.9b2026.0144.4
PPL attackModel Size=2.8b2026.0143.2
zlib attackModel Size=6.9b2026.0136.8
PPL attackModel Size=1.4b2026.0135.6
RS attackModel Size=6.9b2026.0135.6
PETALModel Size=2.8b2026.0133.6
neighborhood attackModel Size=1.4b2026.0132
RS attackModel Size=2.8b2026.0132
MIN-K% PROBModel Size=2.8b2026.0131.6
zlib attackModel Size=2.8b2026.0131.2
PETALModel Size=1.4b2026.0131.2
RS attackModel Size=1.4b2026.0128.8
MIN-K% PROBModel Size=6.9b2026.0128.4
zlib attackModel Size=1.4b2026.0127.6
neighborhood attackModel Size=6.9b2026.0127.2
neighborhood attackModel Size=2.8b2026.0126
BT attackModel Size=2.8b2026.0125.2
BT attackModel Size=6.9b2026.0125.2
MIN-K% PROBModel Size=1.4b2026.0123.6
BT attackModel Size=1.4b2026.0122.8
WS attackModel Size=6.9b2026.0121.6
WS attackModel Size=2.8b2026.0117.2
reference attackModel Size=1.4b2026.0115.2
WS attackModel Size=1.4b2026.0113.6
reference attackModel Size=2.8b2026.0112.8
reference attackModel Size=6.9b2026.019.6