Membership Inference Attack on OLMo near-IID Dolma 3 (test)
0.723AUCAutoMIA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| AutoMIASelection=Best strategy2026.04 | 0.723 | 68.8 | 24 | |
| AutoMIASelection=Average of top-5 strategies2026.04 | 0.716 | 67.8 | 20.7 | |
| MAX 100% RENYI 052026.04 | 0.716 | 67.4 | 21.6 | |
| MODIFIED ENTROPY2026.04 | 0.689 | 65.3 | 17.4 | |
| PPL2026.04 | 0.687 | 65.4 | 19 | |
| MAX 100% RENYI 12026.04 | 0.676 | 64.8 | 13.8 | |
| MODIFIED RENYI 052026.04 | 0.643 | 62.7 | 11.4 | |
| MAX 100% RENYI 22026.04 | 0.642 | 61.8 | 13 | |
| MAX 100% RENYI INF2026.04 | 0.633 | 61.2 | 13.8 | |
| MODIFIED RENYI 22026.04 | 0.609 | 60.2 | 9.8 | |
| MAX 0% RENYI 052026.04 | 0.573 | 57.5 | 10 | |
| MAX 0% RENYI 12026.04 | 0.562 | 56.2 | 10.6 | |
| MAX 0% RENYI 22026.04 | 0.561 | 56.1 | 11 |