List your company
ResearchFormerly WizWand

Membership Inference Attack on SQuADShifts (test)

0.883AUCreference
0.486760.589630.69250.79537May 5, 2026
Updated 5mo ago

Evaluation results

MethodLinks
referencetarget model=Pythia-1.4B, k=1, p=0.22026.050.88317.845.471.1
referencetarget model=Gemma-1.1-2B-IT, k=1, p=12026.050.8828.54774.8
referencetarget model=Gemma-1.1-2B-IT, k=1, p=0.22026.050.87611.93966.2
referencetarget model=Pythia-1.4B, k=1, p=12026.050.87618.245.473.8
referencetarget model=Pythia-1.4B, k=1, p=0.12026.050.8566.738.763.2
referencetarget model=Gemma-1.1-2B-IT, k=1, p=0.12026.050.85412.23764.6
predictions onlytarget model=Gemma-1.1-2B-IT, k=1, p=12026.050.78515.531.848.4
predictions onlytarget model=Gemma-1.1-2B-IT, k=1, p=0.82026.050.78115.331.647.4
predictions onlytarget model=Gemma-1.1-2B-IT, k=1, p=0.52026.050.76814.630.144.1
predictions onlytarget model=Gemma-1.1-2B-IT, k=1, p=0.32026.050.74613.329.440.5
brainwashtarget model=Gemma-1.1-2B-IT, k=12026.050.73611.23140.5
predictions onlytarget model=Gemma-1.1-2B-IT, k=1, p=0.22026.050.7212.927.337.7
predictions onlytarget model=Pythia-1.4B, k=1, p=12026.050.71110.724.935.2
predictions onlytarget model=Pythia-1.4B, k=1, p=0.82026.050.70610.623.833.6
predictions onlytarget model=Pythia-1.4B, k=1, p=0.52026.050.69210.522.131.2
predictions onlytarget model=Pythia-1.4B, k=1, p=0.32026.050.679.22029.7
predictions onlytarget model=Gemma-1.1-2B-IT, k=1, p=0.12026.050.6611.722.131.3
predictions onlytarget model=Pythia-1.4B, k=1, p=0.22026.050.6488.617.928.1
repeattarget model=Pythia-1.4B, k=12026.050.62217.423.630.8
logittarget model=Pythia-1.4B, k=12026.050.61911.417.122.4
logittarget model=Gemma-1.1-2B-IT, k=12026.050.608612.318.4
predictions onlytarget model=Pythia-1.4B, k=1, p=0.12026.050.6057.214.723.8
predictions onlytarget model=Gemma-1.1-2B-IT, k=1, p=0.052026.050.5975.816.825.2
predictions onlytarget model=Pythia-1.4B, k=1, p=0.052026.050.5682.28.716.1
repeattarget model=Gemma-1.1-2B-IT, k=12026.050.564914.922.8
brainwashtarget model=Pythia-1.4B, k=12026.050.5021510