Membership Inference Attack on The Heap All members vs Non-members
0.696ROC-AUCPAC Attack
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PAC AttackModel=Mellum 4B2026.01 | 0.696 | 0.827 | |
| PAC AttackModel=StarCoder2-7B2026.01 | 0.675 | 0.806 | |
| PAC AttackModel=StarCoder2-3B2026.01 | 0.662 | 0.798 | |
| Loss AttackModel=StarCoder2-7B2026.01 | 0.635 | 0.758 | |
| Loss AttackModel=Mellum 4B2026.01 | 0.628 | 0.764 | |
| Loss AttackModel=StarCoder2-3B2026.01 | 0.625 | 0.75 | |
| PAC AttackModel=SmolLM3-3B2026.01 | 0.578 | 0.735 | |
| Loss AttackModel=SmolLM3-3B2026.01 | 0.573 | 0.701 |