Membership Inference Attack on ELD user-level (test)
73TPR @ 0% FPRRMIA
Evaluation Results
| Method | Links | |
|---|---|---|
| RMIATarget Model=N-HiTS, Setting=Online, Signal=Seasonality2025.09 | 73 | |
| DTSTarget Model=N-HiTS, Setting=Online, Attack Model=InceptionTime2025.09 | 65 | |
| RMIATarget Model=N-HiTS, Setting=Online, Signal=TS2Vec2025.09 | 64 | |
| RMIATarget Model=N-HiTS, Setting=Online, Signal=MAE2025.09 | 59 | |
| DTSTarget Model=N-HiTS, Setting=Online, Attack Model=LSTM2025.09 | 56 | |
| LiRATarget Model=N-HiTS, Setting=Online, Signal=rSMAPE2025.09 | 53 | |
| LiRATarget Model=N-HiTS, Setting=Online, Signal=Trend2025.09 | 50 | |
| LiRATarget Model=N-HiTS, Setting=Online, Signal=MAE2025.09 | 49 | |
| LiRATarget Model=N-HiTS, Setting=Online, Signal=Seasonality2025.09 | 49 | |
| LiRATarget Model=N-HiTS, Setting=Online, Signal=TS2Vec2025.09 | 48 | |
| Multi-Signal LiRATarget Model=N-HiTS, Setting=Online2025.09 | 48 | |
| RMIATarget Model=N-HiTS, Setting=Online, Signal=SMAPE2025.09 | 47 | |
| RMIATarget Model=N-HiTS, Setting=Online, Signal=MSE2025.09 | 44 | |
| LiRATarget Model=N-HiTS, Setting=Online, Signal=MSE2025.09 | 43 | |
| LiRATarget Model=N-HiTS, Setting=Online, Signal=SMAPE2025.09 | 43 | |
| LiRATarget Model=LSTM, Setting=Online, Signal=rSMAPE2025.09 | 38 | |
| LiRATarget Model=LSTM, Setting=Online, Signal=MAE2025.09 | 35 | |
| LiRATarget Model=LSTM, Setting=Online, Signal=Seasonality2025.09 | 34 | |
| Multi-Signal LiRATarget Model=LSTM, Setting=Online2025.09 | 34 | |
| DTSTarget Model=LSTM, Setting=Online, Attack Model=LSTM2025.09 | 34 | |
| LiRATarget Model=LSTM, Setting=Online, Signal=TS2Vec2025.09 | 33 | |
| LiRATarget Model=LSTM, Setting=Online, Signal=MSE2025.09 | 29 | |
| LiRATarget Model=LSTM, Setting=Online, Signal=SMAPE2025.09 | 29 | |
| LiRATarget Model=LSTM, Setting=Online, Signal=Trend2025.09 | 27 | |
| DTSTarget Model=LSTM, Setting=Online, Attack Model=InceptionTime2025.09 | 24 | |
| RMIATarget Model=N-HiTS, Setting=Online, Signal=Trend2025.09 | 21 | |
| RMIATarget Model=LSTM, Setting=Online, Signal=MSE2025.09 | 19 | |
| RMIATarget Model=LSTM, Setting=Online, Signal=Seasonality2025.09 | 19 | |
| RMIATarget Model=LSTM, Setting=Online, Signal=TS2Vec2025.09 | 18 | |
| RMIATarget Model=LSTM, Setting=Online, Signal=MAE2025.09 | 16 | |
| RMIATarget Model=LSTM, Setting=Online, Signal=SMAPE2025.09 | 16 | |
| DTSTarget Model=N-HiTS, Setting=Offline, Attack Model=LSTM2025.09 | 13 | |
| RMIATarget Model=LSTM, Setting=Online, Signal=Trend2025.09 | 13 | |
| LiRATarget Model=N-HiTS, Setting=Offline, Signal=rSMAPE2025.09 | 12 | |
| DTSTarget Model=N-HiTS, Setting=Offline, Attack Model=InceptionTime2025.09 | 11 | |
| LiRATarget Model=N-HiTS, Setting=Offline, Signal=SMAPE2025.09 | 10 | |
| LiRATarget Model=N-HiTS, Setting=Offline, Signal=Seasonality2025.09 | 10 | |
| Multi-Signal LiRATarget Model=N-HiTS, Setting=Offline2025.09 | 10 | |
| Ensemble AttackTarget Model=N-HiTS, Signal=Seasonality2025.09 | 9 | |
| LiRATarget Model=N-HiTS, Setting=Offline, Signal=MAE2025.09 | 9 | |
| LiRATarget Model=N-HiTS, Setting=Offline, Signal=TS2Vec2025.09 | 9 | |
| LiRATarget Model=LSTM, Setting=Offline, Signal=rSMAPE2025.09 | 9 | |
| DTSTarget Model=LSTM, Setting=Offline, Attack Model=LSTM2025.09 | 9 | |
| Ensemble AttackTarget Model=N-HiTS, Signal=MSE2025.09 | 8 | |
| RMIATarget Model=N-HiTS, Setting=Offline, Signal=MAE2025.09 | 8 | |
| RMIATarget Model=N-HiTS, Setting=Offline, Signal=SMAPE2025.09 | 8 | |
| LiRATarget Model=LSTM, Setting=Offline, Signal=SMAPE2025.09 | 8 | |
| LiRATarget Model=LSTM, Setting=Offline, Signal=Seasonality2025.09 | 8 | |
| Multi-Signal LiRATarget Model=LSTM, Setting=Offline2025.09 | 8 | |
| RMIATarget Model=N-HiTS, Setting=Offline, Signal=MSE2025.09 | 7 | |
| RMIATarget Model=N-HiTS, Setting=Offline, Signal=Seasonality2025.09 | 7 | |
| RMIATarget Model=N-HiTS, Setting=Offline, Signal=TS2Vec2025.09 | 7 | |
| RMIATarget Model=LSTM, Setting=Offline, Signal=TS2Vec2025.09 | 7 | |
| LiRATarget Model=LSTM, Setting=Offline, Signal=MAE2025.09 | 7 | |
| LiRATarget Model=LSTM, Setting=Offline, Signal=TS2Vec2025.09 | 7 | |
| Ensemble AttackTarget Model=N-HiTS, Signal=MAE2025.09 | 6 | |
| RMIATarget Model=N-HiTS, Setting=Offline, Signal=Trend2025.09 | 6 | |
| LiRATarget Model=N-HiTS, Setting=Offline, Signal=Trend2025.09 | 6 | |
| Ensemble AttackTarget Model=LSTM, Signal=Seasonality2025.09 | 6 | |
| RMIATarget Model=LSTM, Setting=Offline, Signal=MSE2025.09 | 6 | |
| RMIATarget Model=LSTM, Setting=Offline, Signal=Trend2025.09 | 6 | |
| DTSTarget Model=LSTM, Setting=Offline, Attack Model=InceptionTime2025.09 | 6 | |
| Ensemble AttackTarget Model=N-HiTS, Signal=Trend2025.09 | 5 | |
| Ensemble AttackTarget Model=LSTM, Signal=MAE2025.09 | 5 | |
| RMIATarget Model=LSTM, Setting=Offline, Signal=MAE2025.09 | 5 | |
| RMIATarget Model=LSTM, Setting=Offline, Signal=Seasonality2025.09 | 5 | |
| LiRATarget Model=LSTM, Setting=Offline, Signal=Trend2025.09 | 5 | |
| LiRATarget Model=N-HiTS, Setting=Offline, Signal=MSE2025.09 | 4 | |
| Ensemble AttackTarget Model=LSTM, Signal=MSE2025.09 | 4 | |
| RMIATarget Model=LSTM, Setting=Offline, Signal=SMAPE2025.09 | 4 | |
| Ensemble AttackTarget Model=N-HiTS, Signal=rSMAPE2025.09 | 3 | |
| Ensemble AttackTarget Model=LSTM, Signal=SMAPE2025.09 | 3 | |
| Ensemble AttackTarget Model=LSTM, Signal=TS2Vec2025.09 | 3 | |
| LiRATarget Model=LSTM, Setting=Offline, Signal=MSE2025.09 | 3 | |
| Ensemble AttackTarget Model=N-HiTS, Signal=SMAPE2025.09 | 2 | |
| Ensemble AttackTarget Model=N-HiTS, Signal=TS2Vec2025.09 | 2 | |
| Ensemble AttackTarget Model=LSTM, Signal=Trend2025.09 | 2 | |
| Ensemble AttackTarget Model=LSTM, Signal=rSMAPE2025.09 | 0 |