Membership Inference Attack on 4 datasets aggregate
29.2TPR @ 0.1% FPRLT-MIA
Evaluation Results
| Method | Links | |
|---|---|---|
| LT-MIAArchitecture=RWKV2026.04 | 29.2 | |
| LT-MIATarget Architecture=RWKV2026.04 | 29.2 | |
| EZ-MIAArchitecture=RWKV2026.04 | 27.7 | |
| EZ-MIATarget Architecture=RWKV2026.04 | 27.7 | |
| EZ-MIAArchitecture=Mamba2026.04 | 24 | |
| LT-MIAArchitecture=Mamba2026.04 | 24 | |
| EZ-MIATarget Architecture=Mamba2026.04 | 24 | |
| LT-MIATarget Architecture=Mamba2026.04 | 24 | |
| EZ-MIAArchitecture=RecurrentGemma2026.04 | 22.6 | |
| EZ-MIATarget Architecture=RecurrentGemma2026.04 | 22.6 | |
| LT-MIAArchitecture=Mean2026.04 | 21.7 | |
| LT-MIATarget Architecture=Mean2026.04 | 21.7 | |
| EZ-MIAArchitecture=Mean2026.04 | 20.1 | |
| EZ-MIATarget Architecture=Mean2026.04 | 20.1 | |
| LT-MIAArchitecture=Transformer2026.04 | 17.1 | |
| LT-MIATarget Architecture=Transformer2026.04 | 17.1 | |
| LT-MIAArchitecture=RecurrentGemma2026.04 | 16.6 | |
| LT-MIATarget Architecture=RecurrentGemma2026.04 | 16.6 | |
| LossArchitecture=Mamba2026.04 | 15.1 | |
| LossTarget Architecture=Mamba2026.04 | 15.1 | |
| RefLossArchitecture=Mamba2026.04 | 14.8 | |
| RefLossTarget Architecture=Mamba2026.04 | 14.8 | |
| LossArchitecture=RecurrentGemma2026.04 | 7.4 | |
| LossTarget Architecture=RecurrentGemma2026.04 | 7.4 | |
| RefLossArchitecture=Mean2026.04 | 6.6 | |
| RefLossTarget Architecture=Mean2026.04 | 6.6 | |
| LossArchitecture=Mean2026.04 | 6.5 | |
| LossTarget Architecture=Mean2026.04 | 6.5 | |
| EZ-MIAArchitecture=Transformer2026.04 | 6.1 | |
| EZ-MIATarget Architecture=Transformer2026.04 | 6.1 | |
| RefLossArchitecture=RWKV2026.04 | 5.6 | |
| RefLossTarget Architecture=RWKV2026.04 | 5.6 | |
| RefLossArchitecture=RecurrentGemma2026.04 | 4.6 | |
| RefLossTarget Architecture=RecurrentGemma2026.04 | 4.6 | |
| LossArchitecture=RWKV2026.04 | 2.7 | |
| LossTarget Architecture=RWKV2026.04 | 2.7 | |
| RefLossArchitecture=Transformer2026.04 | 1.4 | |
| RefLossTarget Architecture=Transformer2026.04 | 1.4 | |
| LossArchitecture=Transformer2026.04 | 0.9 | |
| LossTarget Architecture=Transformer2026.04 | 0.9 |