Intrusion Detection on UNSW-NB15 (test)
95.29F1 ScoreImp.1: XGBoost-BalSamp
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Imp.1: XGBoost-BalSampCategory=Our Improvements, Params=—2026.05 | 95.29 | 95.45 | 95.26 | 95.33 | — | — | — | |
| BrierBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=52026.05 | 95.1 | — | — | 95.7 | 4.3 | — | — | |
| ExternalityBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=52026.05 | 95.1 | — | — | 95.7 | 4.3 | — | — | |
| Conf-WeightedBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=52026.05 | 95.1 | — | — | 95.7 | 4.3 | — | — | |
| Log-OddsBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=52026.05 | 95.1 | — | — | 95.8 | 4.3 | — | — | |
| Stacking-LRBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=5, Stacking=3-fold cross-validation2026.05 | 95.1 | — | — | 95.1 | 4.9 | — | — | |
| Stacking-MLPBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=5, Stacking=3-fold cross-validation2026.05 | 95.1 | — | — | 94.5 | 5.5 | — | — | |
| Majority VoteBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=52026.05 | 95 | — | — | 95.4 | 4.6 | — | — | |
| VCG (Ours)Base Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=52026.05 | 94.8 | — | — | 95.9 | 4.1 | — | — | |
| ZTA-FL2025.12 | 94.6 | 95.2 | — | — | — | — | — | |
| Best IndividualBase Learners=LightGBM/CatBoost/XGBoost/RF/MLP, Feature Partition Size=60%, Seeds=10, Agents=52026.05 | 94.2 | — | — | 96.3 | 3.7 | — | — | |
| FLAME2025.12 | 93.3 | 93.9 | — | — | — | — | — | |
| FLTrust2025.12 | 92.9 | 93.5 | — | — | — | — | — | |
| FedProx2025.12 | 91.7 | 92.3 | — | — | — | — | — | |
| Imp.2+3+4: PseudoFilter + MixupAug + LiteAECategory=Our Improvements, Params=29,8302026.05 | 91.45 | 90.88 | 94.42 | 88.67 | — | — | — | |
| Imp.2+3: PseudoFilter + MixupAugCategory=Our Improvements, Params=67,2022026.05 | 91.2 | 90.6 | — | — | — | — | — | |
| Imp.2: PseudoFilter onlyCategory=Our Improvements, Params=67,2022026.05 | 90.96 | 90.44 | 94.92 | 87.31 | — | — | — | |
| FedAvg2025.12 | 90.8 | 91.4 | — | — | — | — | — | |
| Imp.2+4: PseudoFilter + LiteAECategory=Our Improvements, Params=29,8302026.05 | 90.7 | 90.2 | — | — | — | — | — | |
| Imp.3: MixupAug onlyCategory=Our Improvements, Params=67,2022026.05 | 90.5 | 89.8 | — | — | — | — | — | |
| AOC-IDS Published [8]Category=Base System (AOC-IDS), Params=67,2022026.05 | 90.14 | 89.19 | 90.65 | 89.7 | — | — | — | |
| AOC-IDS Our ReplicationCategory=Base System (AOC-IDS), Params=67,2022026.05 | 90.12 | 89.39 | 90.48 | 89.85 | — | — | — | |
| Krum2025.12 | 90.1 | 90.7 | — | — | — | — | — | |
| Imp.4: LiteAE onlyCategory=Our Improvements, Params=29,8302026.05 | 89.8 | 88.5 | — | — | — | — | — | |
| XGBoost (Online)Category=Baselines models (from [8]), Params=—2026.05 | 89.26 | 86.97 | 82.85 | 98.29 | — | — | — | |
| FedEPDistribution=non-IID, Client Nodes=202026.02 | 88.97 | 83.31 | 82.17 | 97 | 3 | — | — | |
| RF (Online)Category=Baselines models (from [8]), Params=—2026.05 | 88.55 | 85.93 | 80.25 | 98.75 | — | — | — | |
| DTC (Online)Category=Baselines models (from [8]), Params=—2026.05 | 88.15 | 85.95 | 82.32 | 94.86 | — | — | — | |
| FedPGDistribution=non-IID, Client Nodes=202026.02 | 87.2 | 80.93 | 81.58 | 93.66 | 6.34 | — | — | |
| CIDSCategory=Baselines models (from [8]), Params=—2026.05 | 86.03 | 82.61 | 78.91 | 96.28 | — | — | — | |
| FeCoCategory=Baselines models (from [8]), Params=—2026.05 | 68.93 | 72.5 | 91.18 | 55.41 | — | — | — | |
| Khan et al.2026.02 | 59.73 | 65.38 | 69.69 | 54.34 | — | — | — | |
| Mohamed et al.2026.02 | 56.57 | 66.07 | 76.01 | 46.34 | — | — | — | |
| CMDNumber of features=40, Classifier=3-hidden-layer MLP2026.06 | — | — | — | — | — | 36.46 | — | |
| Fisher ScoreNumber of features=40, Classifier=3-hidden-layer MLP2026.06 | — | — | — | — | — | 36.52 | — | |
| Mutual InformationNumber of features=40, Classifier=3-hidden-layer MLP2026.06 | — | — | — | — | — | 36.7 | — | |
| nCMDNumber of features=40, Classifier=3-hidden-layer MLP2026.06 | — | — | — | — | — | 37.4 | — | |
| Pearson CorrelationNumber of features=40, Classifier=3-hidden-layer MLP2026.06 | — | — | — | — | — | 32.46 | — | |
| QCL-IDSevaluation_protocol=Reported values (approximate reference)2026.07 | — | — | — | — | — | — | 94.1 | |
| RES-DAREevaluation_protocol=Standard pipeline reproduction2026.07 | — | — | — | — | — | — | 98.04 | |
| Variance ThresholdNumber of features=40, Classifier=3-hidden-layer MLP2026.06 | — | — | — | — | — | 34.36 | — |