Membership Inference Attack on The Heap Exact members vs Non-members
0.712ROC-AUCPAC Attack
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PAC AttackModel=Mellum 4B2026.01 | 0.712 | 0.742 | |
| PAC AttackModel=StarCoder2-7B2026.01 | 0.678 | 0.694 | |
| PAC AttackModel=StarCoder2-3B2026.01 | 0.662 | 0.68 | |
| Loss AttackModel=StarCoder2-7B2026.01 | 0.634 | 0.611 | |
| Loss AttackModel=Mellum 4B2026.01 | 0.629 | 0.628 | |
| Loss AttackModel=StarCoder2-3B2026.01 | 0.622 | 0.6 | |
| PAC AttackModel=SmolLM3-3B2026.01 | 0.579 | 0.591 | |
| Loss AttackModel=SmolLM3-3B2026.01 | 0.572 | 0.539 |