List your company

Membership Inference on DM Math Pythia (train)

99.3TPR@1%FPRAttenMIA (Perturbed)
19.01239.85660.781.544Jan 26, 2026

Evaluation results

MethodLinks
AttenMIA (Perturbed)Model Size=6.9b2026.0199.3
AttenMIA (Perturbed)Model Size=1.4b2026.0198.9
AttenMIA (Perturbed)Model Size=2.8b2026.0198.8
AttenMIA (Transitional)Model Size=2.8b2026.0187.8
AttenMIA (Transitional)Model Size=1.4b2026.0186.7
AttenMIA (Transitional)Model Size=6.9b2026.0185.6
PPL attackModel Size=1.4b2026.0151.7
reference attackModel Size=2.8b2026.0150.6
reference attackModel Size=1.4b2026.0149.4
reference attackModel Size=6.9b2026.0147.2
RECALLModel Size=1.4b2026.0144.2
PPL attackModel Size=6.9b2026.0142.7
PPL attackModel Size=2.8b2026.0134.8
RECALLModel Size=2.8b2026.0131.2
RECALLModel Size=6.9b2026.0122.1