Membership Inference Attack on CAMEL Math Reasoning
0.9901AUCAll3Layers (MINT-based)
Evaluation Results
| Method | Links | |
|---|---|---|
| All3Layers (MINT-based)Model=DeepSeek-V32026.06 | 0.9901 | |
| L2 (MINT-based)Model=DeepSeek-V32026.06 | 0.9865 | |
| L3 (MINT-based)Model=DeepSeek-V32026.06 | 0.9843 | |
| L1 (MINT-based)Model=DeepSeek-V32026.06 | 0.9841 | |
| All3Layers (MINT-based)Model=LLaMA 3.2-3B2026.06 | 0.9645 | |
| L3 (MINT-based)Model=LLaMA 3.2-3B2026.06 | 0.963 | |
| L2 (MINT-based)Model=LLaMA 3.2-3B2026.06 | 0.9591 | |
| All3Layers (MINT-based)Model=Phi-42026.06 | 0.9578 | |
| L1 (MINT-based)Model=Phi-42026.06 | 0.9533 | |
| All3Layers (MINT-based)Model=Qwen32026.06 | 0.9514 | |
| L2 (MINT-based)Model=Phi-42026.06 | 0.9496 | |
| L3 (MINT-based)Model=Qwen32026.06 | 0.9485 | |
| L3 (MINT-based)Model=Phi-42026.06 | 0.948 | |
| L2 (MINT-based)Model=Qwen32026.06 | 0.9429 | |
| GradProbLossModel=Phi-42026.06 | 0.94 | |
| L1 (MINT-based)Model=Qwen32026.06 | 0.9294 | |
| GradProbLossModel=DeepSeek-V32026.06 | 0.9254 | |
| GradProbLossModel=Qwen32026.06 | 0.9201 | |
| MinKModel=Phi-42026.06 | 0.916 | |
| LossModel=Phi-42026.06 | 0.916 | |
| LossModel=DeepSeek-V32026.06 | 0.9051 | |
| MinKModel=DeepSeek-V32026.06 | 0.905 | |
| L1 (MINT-based)Model=LLaMA 3.2-3B2026.06 | 0.8948 | |
| LossModel=Qwen32026.06 | 0.8838 | |
| MinK++Model=Phi-42026.06 | 0.873 | |
| MinKModel=Qwen32026.06 | 0.872 | |
| GradProbLossModel=LLaMA 3.2-3B2026.06 | 0.8639 | |
| MinK++Model=DeepSeek-V32026.06 | 0.8465 | |
| MinKModel=LLaMA 3.2-3B2026.06 | 0.809 | |
| LossModel=LLaMA 3.2-3B2026.06 | 0.809 | |
| OnlyGradModel=Phi-42026.06 | 0.8047 | |
| MinK++Model=LLaMA 3.2-3B2026.06 | 0.7985 | |
| OnlyGradModel=DeepSeek-V32026.06 | 0.7895 | |
| MinK++Model=Qwen32026.06 | 0.7823 | |
| OnlyGradModel=LLaMA 3.2-3B2026.06 | 0.7536 | |
| OnlyGradModel=Qwen32026.06 | 0.7073 |