List your company
ResearchFormerly WizWand

Membership Inference Attack on WikiMIA-25

0.961AUCReCaLL
0.484680.608340.7320.85566Jan 16, 2026
Updated 8mo ago

Evaluation results

MethodLinks
ReCaLLAccess Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.96178.8
ReCaLLAccess Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.9143.4
SimMIA*Access Setting=Black-Box, Target Model=Pythia-6.9B, Scoring Method=Eq. 12026.010.90630.1
SimMIA*Access Setting=Black-Box, Target Model=GPT-5-Chat, Scoring Method=Eq. 12026.010.90271.7
SimMIAAccess Setting=Black-Box, Target Model=Claude-4.5-Haiku, Scoring Method=Eq. 32026.010.86751.3
SimMIAAccess Setting=Black-Box, Target Model=Pythia-6.9B, Scoring Method=Eq. 32026.010.858.8
SimMIA*Access Setting=Black-Box, Target Model=Claude-4.5-Haiku, Scoring Method=Eq. 12026.010.80837.2
PETALAccess Setting=Grey-Box, Target Model=GPT-5-Chat2026.010.7835.4
SimMIA*Access Setting=Black-Box, Target Model=Gemini-2.5-Flash, Scoring Method=Eq. 12026.010.77432.7
Min-K%Access Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.77338.9
SimMIAAccess Setting=Black-Box, Target Model=GPT-5-Chat, Scoring Method=Eq. 32026.010.75721.2
SimMIAAccess Setting=Black-Box, Target Model=Gemini-2.5-Flash, Scoring Method=Eq. 32026.010.75429.2
SimMIAAccess Setting=Black-Box, Target Model=Qwen3-8B-Base, Scoring Method=Eq. 32026.010.7494.4
LossAccess Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.7336.3
Min-K%++Access Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.72741.6
ZlibAccess Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.72231.9
PETALAccess Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.72230.1
LowercaseAccess Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.70723
PETALAccess Setting=Grey-Box, Target Model=Gemini-2.5-Flash2026.010.67123.9
SaMIAAccess Setting=Black-Box, Target Model=GPT-5-Chat2026.010.65713.3
ReferenceAccess Setting=Grey-Box, Target Model=Pythia-6.9B2026.010.6528.9
SimMIA*Access Setting=Black-Box, Target Model=Qwen3-8B-Base, Scoring Method=Eq. 12026.010.6295.3
PETALAccess Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.62818.6
Min-K%++Access Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.62720.4
SaMIAAccess Setting=Black-Box, Target Model=Claude-4.5-Haiku2026.010.6268
LowercaseAccess Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.59419.5
LossAccess Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.59111.5
SaMIAAccess Setting=Black-Box, Target Model=Pythia-6.9B2026.010.5788.8
ZlibAccess Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.5758.9
SaMIAAccess Setting=Black-Box, Target Model=Gemini-2.5-Flash2026.010.5715
Min-K%Access Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.56814.2
ReferenceAccess Setting=Grey-Box, Target Model=Qwen3-8B-Base2026.010.5393.5
SaMIAAccess Setting=Black-Box, Target Model=Qwen3-8B-Base2026.010.5032.7