List your company
ResearchFormerly WizWand

Membership Inference Attack on CAMEL Math Reasoning

0.9901AUCAll3Layers (MINT-based)
0.6959880.7723440.84870.925056Jun 5, 2026
Updated 4mo ago

Evaluation results

MethodLinks
All3Layers (MINT-based)Model=DeepSeek-V32026.060.9901
L2 (MINT-based)Model=DeepSeek-V32026.060.9865
L3 (MINT-based)Model=DeepSeek-V32026.060.9843
L1 (MINT-based)Model=DeepSeek-V32026.060.9841
All3Layers (MINT-based)Model=LLaMA 3.2-3B2026.060.9645
L3 (MINT-based)Model=LLaMA 3.2-3B2026.060.963
L2 (MINT-based)Model=LLaMA 3.2-3B2026.060.9591
All3Layers (MINT-based)Model=Phi-42026.060.9578
L1 (MINT-based)Model=Phi-42026.060.9533
All3Layers (MINT-based)Model=Qwen32026.060.9514
L2 (MINT-based)Model=Phi-42026.060.9496
L3 (MINT-based)Model=Qwen32026.060.9485
L3 (MINT-based)Model=Phi-42026.060.948
L2 (MINT-based)Model=Qwen32026.060.9429
GradProbLossModel=Phi-42026.060.94
L1 (MINT-based)Model=Qwen32026.060.9294
GradProbLossModel=DeepSeek-V32026.060.9254
GradProbLossModel=Qwen32026.060.9201
MinKModel=Phi-42026.060.916
LossModel=Phi-42026.060.916
LossModel=DeepSeek-V32026.060.9051
MinKModel=DeepSeek-V32026.060.905
L1 (MINT-based)Model=LLaMA 3.2-3B2026.060.8948
LossModel=Qwen32026.060.8838
MinK++Model=Phi-42026.060.873
MinKModel=Qwen32026.060.872
GradProbLossModel=LLaMA 3.2-3B2026.060.8639
MinK++Model=DeepSeek-V32026.060.8465
MinKModel=LLaMA 3.2-3B2026.060.809
LossModel=LLaMA 3.2-3B2026.060.809
OnlyGradModel=Phi-42026.060.8047
MinK++Model=LLaMA 3.2-3B2026.060.7985
OnlyGradModel=DeepSeek-V32026.060.7895
MinK++Model=Qwen32026.060.7823
OnlyGradModel=LLaMA 3.2-3B2026.060.7536
OnlyGradModel=Qwen32026.060.7073