Membership Inference Attack on 4 natural language datasets (aggregated)
59.3TPR @ 1% FPRLT-MIA
Evaluation results
| Method | Links | |
|---|---|---|
| LT-MIATarget Architecture=RWKV2026.04 | 59.3 | |
| LT-MIATarget Architecture=Mamba2026.04 | 56.9 | |
| EZ-MIATarget Architecture=Mamba2026.04 | 52.6 | |
| LT-MIATarget Architecture=Mean2026.04 | 48.4 | |
| EZ-MIATarget Architecture=RWKV2026.04 | 43.9 | |
| LT-MIATarget Architecture=RecurrentGemma2026.04 | 39.9 | |
| LT-MIATarget Architecture=Transformer2026.04 | 37.5 | |
| EZ-MIATarget Architecture=Mean2026.04 | 36.7 | |
| LossTarget Architecture=Mamba2026.04 | 35.6 | |
| RefLossTarget Architecture=Mamba2026.04 | 34.6 | |
| RefLossTarget Architecture=RWKV2026.04 | 30.8 | |
| EZ-MIATarget Architecture=RecurrentGemma2026.04 | 27.3 | |
| EZ-MIATarget Architecture=Transformer2026.04 | 23 | |
| RefLossTarget Architecture=Mean2026.04 | 20.1 | |
| LossTarget Architecture=RecurrentGemma2026.04 | 18.5 | |
| LossTarget Architecture=Mean2026.04 | 17.1 | |
| LossTarget Architecture=RWKV2026.04 | 10.8 | |
| RefLossTarget Architecture=RecurrentGemma2026.04 | 9.4 | |
| RefLossTarget Architecture=Transformer2026.04 | 5.6 | |
| LossTarget Architecture=Transformer2026.04 | 3.6 |