Membership Inference Attack on Maths & College Reasoning
99.01AUCAll3Layers (MINT-based)
Evaluation results
| Method | Links | |
|---|---|---|
| All3Layers (MINT-based)Model=DeepSeek-V32026.06 | 99.01 | |
| L3 (MINT-based)Model=DeepSeek-V32026.06 | 98.66 | |
| All3Layers (MINT-based)Model=Qwen32026.06 | 98.57 | |
| L2 (MINT-based)Model=Qwen32026.06 | 98.55 | |
| L1 (MINT-based)Model=Qwen32026.06 | 98.48 | |
| L2 (MINT-based)Model=DeepSeek-V32026.06 | 98.45 | |
| All3Layers (MINT-based)Model=Phi-42026.06 | 98.45 | |
| MinKModel=DeepSeek-V32026.06 | 98.4 | |
| L3 (MINT-based)Model=Phi-42026.06 | 98.21 | |
| L1 (MINT-based)Model=DeepSeek-V32026.06 | 98.1 | |
| L3 (MINT-based)Model=Qwen32026.06 | 98.1 | |
| L2 (MINT-based)Model=Phi-42026.06 | 98.01 | |
| All3Layers (MINT-based)Model=LLaMA 3.2-3B2026.06 | 97.92 | |
| GradProbLossModel=DeepSeek-V32026.06 | 97.85 | |
| GradProbLossModel=Qwen32026.06 | 97.79 | |
| L1 (MINT-based)Model=LLaMA 3.2-3B2026.06 | 97.47 | |
| L2 (MINT-based)Model=LLaMA 3.2-3B2026.06 | 97.43 | |
| L3 (MINT-based)Model=LLaMA 3.2-3B2026.06 | 97.26 | |
| GradProbLossModel=LLaMA 3.2-3B2026.06 | 96.27 | |
| LossModel=DeepSeek-V32026.06 | 96.1 | |
| MinK++Model=Qwen32026.06 | 95.9 | |
| L1 (MINT-based)Model=Phi-42026.06 | 95.21 | |
| MinKModel=Qwen32026.06 | 94.4 | |
| GradProbLossModel=Phi-42026.06 | 93.98 | |
| LossModel=Qwen32026.06 | 93.8 | |
| LossModel=Phi-42026.06 | 92.1 | |
| MinKModel=Phi-42026.06 | 90.21 | |
| MinK++Model=DeepSeek-V32026.06 | 89.45 | |
| MinKModel=LLaMA 3.2-3B2026.06 | 84.9 | |
| MinK++Model=Phi-42026.06 | 84.64 | |
| OnlyGradModel=Phi-42026.06 | 84.24 | |
| OnlyGradModel=LLaMA 3.2-3B2026.06 | 84.2 | |
| MinK++Model=LLaMA 3.2-3B2026.06 | 79.54 | |
| LossModel=LLaMA 3.2-3B2026.06 | 78.5 | |
| OnlyGradModel=DeepSeek-V32026.06 | 74.62 | |
| OnlyGradModel=Qwen32026.06 | 65.48 |