List your company
ResearchFormerly WizWand

Membership Inference Attack on SQuADShifts

0.9AUCreference
0.514160.614330.71450.81467May 5, 2026
Updated 5mo ago

Evaluation results

MethodLinks
referenceTarget Model=Gemma-7B-IT, k=1, p=12026.050.919.758.575.8
referenceTarget Model=Gemma-7B-IT, k=1, p=0.12026.050.89417.451.575
referenceTarget Model=Gemma-7B-IT, k=1, p=0.22026.050.89314.848.675
logitTarget Model=Gemma-7B-IT, k=1, p=-2026.050.844.622.844.9
prediction onlyTarget Model=Gemma-7B-IT, k=1, p=0.052026.050.6364.112.520.6
prediction onlyTarget Model=Gemma-7B-IT, k=1, p=0.22026.050.6272.612.723.3
prediction onlyTarget Model=Gemma-7B-IT, k=1, p=0.12026.050.6233.79.818.3
prediction onlyTarget Model=Gemma-7B-IT, k=1, p=0.32026.050.6062.411.217.2
prediction onlyTarget Model=Gemma-7B-IT, k=1, p=0.82026.050.5932.49.320.5
prediction onlyTarget Model=Gemma-7B-IT, k=1, p=0.52026.050.5812.513.222.2
prediction onlyTarget Model=Gemma-7B-IT, k=1, p=12026.050.5732.37.915.5
repeatTarget Model=Gemma-7B-IT, k=1, p=-2026.050.54127.614.1
brainwashTarget Model=Gemma-7B-IT, k=1, p=-2026.050.5291.15.611.2