Intrusion Detection on ToN_IoT chronological (in-distribution) (test)
99.4AUC-ROCThreatFormer-IDS
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ThreatFormer-IDSLatency (ms/seq)=0.96±0.052026.02 | 99.4 | 95.6 | 91 | 97.6 | 0.49 | |
| Transformer (base)Latency (ms/seq)=0.88±0.052026.02 | 99 | 94.4 | 89.1 | 96.8 | 0.56 | |
| TCNLatency (ms/seq)=0.70±0.052026.02 | 98.9 | 94.1 | 88.6 | 96.6 | 0.58 | |
| BiLSTMLatency (ms/seq)=0.83±0.052026.02 | 98.8 | 93.8 | 88.1 | 96.5 | 0.6 | |
| 1D-CNNLatency (ms/seq)=0.55±0.052026.02 | 98.6 | 93.2 | 87.2 | 96.1 | 0.64 | |
| LightGBMLatency (ms/seq)=0.95±0.052026.02 | 98.3 | 92.6 | 86.1 | 95.6 | 0.72 | |
| XGBoostLatency (ms/seq)=1.25±0.052026.02 | 98.2 | 92.1 | 85.6 | 95.5 | 0.74 | |
| MLP (seq-pooled)Latency (ms/seq)=0.62±0.052026.02 | 97.9 | 91.3 | 84.7 | 95.2 | 0.78 | |
| Random ForestLatency (ms/seq)=1.80±0.052026.02 | 97.2 | 90.1 | 83.1 | 94.4 | 0.98 | |
| Logistic RegressionLatency (ms/seq)=0.28±0.052026.02 | 94.1 | 82.1 | 74.4 | 91.2 | 1.62 |