Membership Inference on SteamMIA
49.77Hit Rate (Non-members)Deepseek-V3-Chat
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Deepseek-V3-ChatLLM=Deepseek-V3-Chat2026.06 | 49.77 | 61.85 | -12.08 | 0.0005 | -7 | |
| Gemini-1.5-Flash*LLM=Gemini-1.5-Flash*, Knowledge Cutoff Date=Later than December 20232026.06 | 44.37 | 46.32 | -1.95 | 0.2808 | 4 | |
| LLaMA-3-70BLLM=LLaMA-3-70B2026.06 | 43.92 | 58.06 | -14.14 | 0.0001 | -9 | |
| Claude-3-HaikuLLM=Claude-3-Haiku2026.06 | 40.54 | 54.5 | -13.96 | 0.0001 | -8 | |
| GPT-4o-MiniLLM=GPT-4o-Mini2026.06 | 37.16 | 46.21 | -9.05 | 0.0033 | -4 | |
| LLaMA-3.1-8B-InstructLLM=LLaMA-3.1-8B-Instruct2026.06 | 36.26 | 48.5 | -12.24 | 0.0001 | -7 |