Membership Inference Attack on The Heap (Near members vs Non-members)
0.679ROC AUCPAC Attack
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PAC AttackModel=Mellum 4B2026.01 | 0.679 | 0.691 | |
| PAC AttackModel=StarCoder2-7B2026.01 | 0.672 | 0.674 | |
| PAC AttackModel=StarCoder2-3B2026.01 | 0.661 | 0.664 | |
| Loss AttackModel=StarCoder2-7B2026.01 | 0.637 | 0.614 | |
| Loss AttackModel=StarCoder2-3B2026.01 | 0.629 | 0.605 | |
| Loss AttackModel=Mellum 4B2026.01 | 0.626 | 0.617 | |
| PAC AttackModel=SmolLM3-3B2026.01 | 0.578 | 0.579 | |
| Loss AttackModel=SmolLM3-3B2026.01 | 0.575 | 0.541 |