List your company
ResearchFormerly WizWand

Membership Inference Attack on ELD record-level (test)

6.66TPR @ 0.1% FPRDTS
-0.26641.53183.335.1282Sep 4, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DTSTarget Model=N-HiTS, Setting=Online, Attack Model=InceptionTime2025.096.662.94
DTSTarget Model=N-HiTS, Setting=Online, Attack Model=LSTM2025.096.342.77
DTSTarget Model=LSTM, Setting=Online, Attack Model=LSTM2025.094.782.57
DTSTarget Model=LSTM, Setting=Online, Attack Model=InceptionTime2025.094.492.4
Multi-Signal LiRATarget Model=LSTM, Setting=Online2025.094.152.29
LiRATarget Model=LSTM, Setting=Online, Signal=TS2Vec2025.093.51.68
LiRATarget Model=LSTM, Setting=Online, Signal=Seasonality2025.093.461.43
LiRATarget Model=LSTM, Setting=Online, Signal=MAE2025.093.291.47
LiRATarget Model=LSTM, Setting=Online, Signal=rSMAPE2025.093.10.93
Multi-Signal LiRATarget Model=N-HiTS, Setting=Online2025.092.320.85
LiRATarget Model=LSTM, Setting=Online, Signal=MSE2025.092.260.84
LiRATarget Model=LSTM, Setting=Online, Signal=SMAPE2025.092.180.78
LiRATarget Model=N-HiTS, Setting=Online, Signal=TS2Vec2025.092.160.88
LiRATarget Model=N-HiTS, Setting=Online, Signal=Seasonality2025.092.020.76
LiRATarget Model=N-HiTS, Setting=Online, Signal=MAE2025.091.990.65
LiRATarget Model=N-HiTS, Setting=Online, Signal=rSMAPE2025.091.940.59
LiRATarget Model=N-HiTS, Setting=Online, Signal=SMAPE2025.091.50.46
LiRATarget Model=N-HiTS, Setting=Online, Signal=Trend2025.091.340.45
RMIATarget Model=LSTM, Setting=Offline, Signal=MAE2025.091.290.03
RMIATarget Model=LSTM, Setting=Offline, Signal=MSE2025.091.280.26
RMIATarget Model=N-HiTS, Setting=Online, Signal=MAE2025.091.190.26
LiRATarget Model=LSTM, Setting=Online, Signal=Trend2025.091.170.31
RMIATarget Model=LSTM, Setting=Online, Signal=MSE2025.091.160.15
RMIATarget Model=N-HiTS, Setting=Online, Signal=MSE2025.091.120.31
LiRATarget Model=N-HiTS, Setting=Online, Signal=MSE2025.091.060.28
RMIATarget Model=LSTM, Setting=Online, Signal=MAE2025.0910.13
RMIATarget Model=N-HiTS, Setting=Online, Signal=Seasonality2025.090.970.04
RMIATarget Model=N-HiTS, Setting=Offline, Signal=Seasonality2025.090.890.31
RMIATarget Model=N-HiTS, Setting=Online, Signal=TS2Vec2025.090.790.03
DTSTarget Model=LSTM, Setting=Offline, Attack Model=InceptionTime2025.090.780.3
RMIATarget Model=LSTM, Setting=Offline, Signal=TS2Vec2025.090.770.36
DTSTarget Model=LSTM, Setting=Offline, Attack Model=LSTM2025.090.760.26
DTSTarget Model=N-HiTS, Setting=Offline, Attack Model=InceptionTime2025.090.680.21
RMIATarget Model=LSTM, Setting=Offline, Signal=Seasonality2025.090.680.42
RMIATarget Model=N-HiTS, Setting=Online, Signal=SMAPE2025.090.670.09
RMIATarget Model=N-HiTS, Setting=Offline, Signal=TS2Vec2025.090.610.03
RMIATarget Model=LSTM, Setting=Offline, Signal=SMAPE2025.090.610
LiRATarget Model=N-HiTS, Setting=Offline, Signal=rSMAPE2025.090.590.13
DTSTarget Model=N-HiTS, Setting=Offline, Attack Model=LSTM2025.090.570.15
LiRATarget Model=N-HiTS, Setting=Offline, Signal=TS2Vec2025.090.520.26
RMIATarget Model=N-HiTS, Setting=Offline, Signal=MAE2025.090.50
RMIATarget Model=LSTM, Setting=Online, Signal=Seasonality2025.090.460.08
LiRATarget Model=LSTM, Setting=Offline, Signal=TS2Vec2025.090.410.1
RMIATarget Model=LSTM, Setting=Online, Signal=TS2Vec2025.090.40.1
Multi-Signal LiRATarget Model=LSTM, Setting=Offline2025.090.370.06
LiRATarget Model=N-HiTS, Setting=Offline, Signal=SMAPE2025.090.350.09
RMIATarget Model=N-HiTS, Setting=Offline, Signal=Trend2025.090.340.03
LiRATarget Model=LSTM, Setting=Offline, Signal=rSMAPE2025.090.340.07
Multi-Signal LiRATarget Model=N-HiTS, Setting=Offline2025.090.320.08
LiRATarget Model=N-HiTS, Setting=Offline, Signal=Seasonality2025.090.30.08
LiRATarget Model=N-HiTS, Setting=Offline, Signal=MAE2025.090.260.07
RMIATarget Model=LSTM, Setting=Online, Signal=SMAPE2025.090.240.04
LiRATarget Model=LSTM, Setting=Offline, Signal=Seasonality2025.090.240.07
LiRATarget Model=N-HiTS, Setting=Offline, Signal=Trend2025.090.220.05
LiRATarget Model=LSTM, Setting=Offline, Signal=MAE2025.090.210.02
LiRATarget Model=LSTM, Setting=Offline, Signal=SMAPE2025.090.180.05
RMIATarget Model=N-HiTS, Setting=Online, Signal=Trend2025.090.170.02
RMIATarget Model=LSTM, Setting=Offline, Signal=Trend2025.090.160.02
RMIATarget Model=LSTM, Setting=Online, Signal=Trend2025.090.090.01
LiRATarget Model=N-HiTS, Setting=Offline, Signal=MSE2025.090.070.01
RMIATarget Model=N-HiTS, Setting=Offline, Signal=MSE2025.090.060
LiRATarget Model=LSTM, Setting=Offline, Signal=Trend2025.090.060.01
LiRATarget Model=LSTM, Setting=Offline, Signal=MSE2025.090.030
Ensemble AttackTarget Model=N-HiTS, Signal=SMAPE2025.090.020
RMIATarget Model=N-HiTS, Setting=Offline, Signal=SMAPE2025.090.020
Ensemble AttackTarget Model=LSTM, Signal=SMAPE2025.090.020
Ensemble AttackTarget Model=N-HiTS, Signal=MSE2025.090.010
Ensemble AttackTarget Model=N-HiTS, Signal=Trend2025.090.010
Ensemble AttackTarget Model=N-HiTS, Signal=MAE2025.0900
Ensemble AttackTarget Model=N-HiTS, Signal=rSMAPE2025.0900
Ensemble AttackTarget Model=N-HiTS, Signal=Seasonality2025.0900
Ensemble AttackTarget Model=N-HiTS, Signal=TS2Vec2025.0900
Ensemble AttackTarget Model=LSTM, Signal=MSE2025.0900
Ensemble AttackTarget Model=LSTM, Signal=MAE2025.0900
Ensemble AttackTarget Model=LSTM, Signal=rSMAPE2025.0900
Ensemble AttackTarget Model=LSTM, Signal=Trend2025.0900
Ensemble AttackTarget Model=LSTM, Signal=Seasonality2025.0900
Ensemble AttackTarget Model=LSTM, Signal=TS2Vec2025.0900