Membership Inference on PERSON entity category OpenLLaMA-7B (test)
93Balanced Accuracyrepeated interrogation
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| repeated interrogationInference Target=Entity-level, Classifier=MLP2026.06 | 93 | 96.5 | 25 | 94 | |
| repeated interrogationInference Target=Entity-level, Classifier=RF2026.06 | 92.8 | 97 | 26.5 | 92.5 | |
| repeated interrogationInference Target=Entity-level, Classifier=LR2026.06 | 92.3 | 96.7 | 29 | 91.5 | |
| repeated interrogationInference Target=Entity-level, Classifier=MV2026.06 | 92 | 96.7 | 30.5 | 92 | |
| multirole interrogationInference Target=Entity-level, Classifier=RF2026.06 | 91.5 | 96.2 | 59 | 92.5 | |
| multirole interrogationInference Target=Entity-level, Classifier=LR2026.06 | 91.5 | 96.5 | 68.5 | 91.5 | |
| multirole interrogationInference Target=Entity-level, Classifier=MLP2026.06 | 91.5 | 96.4 | 67.5 | 91.5 | |
| multirole interrogationInference Target=Entity-level, Classifier=MV2026.06 | 91.3 | 96.4 | 69.5 | 91 | |
| multiangle interrogationInference Target=Entity-level, Classifier=RF2026.06 | 91.3 | 96.8 | 72.5 | 91 | |
| multiangle interrogationInference Target=Entity-level, Classifier=MLP2026.06 | 91.3 | 96.7 | 70 | 92 | |
| multiangle interrogationInference Target=Entity-level, Classifier=LR2026.06 | 91 | 96.9 | 70.5 | 90.5 | |
| multiangle interrogationInference Target=Entity-level, Classifier=MV2026.06 | 90.5 | 96.8 | 69.5 | 88.5 | |
| misleading interrogationInference Target=Entity-level, Classifier=RF2026.06 | 88.5 | 94.3 | 10.5 | 85.5 | |
| misleading interrogationInference Target=Entity-level, Classifier=LR2026.06 | 87.8 | 93.4 | 15 | 81 | |
| misleading interrogationInference Target=Entity-level, Classifier=MLP2026.06 | 87.8 | 93.1 | 6 | 83 | |
| misleading interrogationInference Target=Entity-level, Classifier=MV2026.06 | 84.7 | 91 | 5 | 72.5 | |
| gradual interrogationInference Target=Entity-level, Classifier=MV2026.06 | 83 | 87.2 | 21.5 | 53.5 | |
| gradual interrogationInference Target=Entity-level, Classifier=RF2026.06 | 82.3 | 88.5 | 9.5 | 66 | |
| gradual interrogationInference Target=Entity-level, Classifier=MLP2026.06 | 82.3 | 88.1 | 24 | 54 | |
| gradual interrogationInference Target=Entity-level, Classifier=LR2026.06 | 81.5 | 87.9 | 17 | 56 | |
| PETALInference Target=Sample-level2026.06 | 75.5 | 80 | 38 | 58.5 | |
| ICP-MIA-SP (Generation-based)Inference Target=Sample-level2026.06 | 67.5 | 71.5 | 23.5 | 39.5 | |
| ICP-MIA-SP (Masking-based)Inference Target=Sample-level2026.06 | 60.3 | 59.8 | 2 | 19 |