List your company
ResearchFormerly WizWand

Membership Inference Attack on Medical-o1 reasoning-SFT

0.9851AUCAll3Layers (MINT-based)
0.5770040.6829520.78890.894848Jun 5, 2026
Updated 4mo ago

Evaluation results

MethodLinks
All3Layers (MINT-based)Model=DeepSeek-V32026.060.9851
L3 (MINT-based)Model=DeepSeek-V32026.060.9846
L2 (MINT-based)Model=DeepSeek-V32026.060.984
All3Layers (MINT-based)Model=Phi-42026.060.9819
L3 (MINT-based)Model=Phi-42026.060.9811
L1 (MINT-based)Model=Phi-42026.060.98
L2 (MINT-based)Model=Phi-42026.060.9788
L1 (MINT-based)Model=DeepSeek-V32026.060.9697
MinK++Model=Phi-42026.060.959
MinKModel=Phi-42026.060.944
GradProbLossModel=DeepSeek-V32026.060.9435
LossModel=Phi-42026.060.939
All3Layers (MINT-based)Model=Qwen32026.060.9302
L3 (MINT-based)Model=Qwen32026.060.9272
All3Layers (MINT-based)Model=LLaMA 3.2-3B2026.060.924
L3 (MINT-based)Model=LLaMA 3.2-3B2026.060.921
L2 (MINT-based)Model=LLaMA 3.2-3B2026.060.9202
L2 (MINT-based)Model=Qwen32026.060.9179
MinKModel=DeepSeek-V32026.060.884
LossModel=DeepSeek-V32026.060.884
L1 (MINT-based)Model=LLaMA 3.2-3B2026.060.8811
MinK++Model=DeepSeek-V32026.060.8625
GradProbLossModel=LLaMA 3.2-3B2026.060.8394
L1 (MINT-based)Model=Qwen32026.060.8306
LossModel=LLaMA 3.2-3B2026.060.8
GradProbLossModel=Qwen32026.060.792
MinK++Model=LLaMA 3.2-3B2026.060.7812
MinK++Model=Qwen32026.060.778
MinKModel=LLaMA 3.2-3B2026.060.777
MinKModel=Qwen32026.060.769
LossModel=Qwen32026.060.7508
OnlyGradModel=Phi-42026.060.7132
OnlyGradModel=Qwen32026.060.6706
OnlyGradModel=DeepSeek-V32026.060.6683
GradProbLossModel=Phi-42026.060.6323
OnlyGradModel=LLaMA 3.2-3B2026.060.5927