Intrusion Detection on QUT-GOOSE ZSS 2023 (test)
0.604MCCXGBoost (Eng.)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| XGBoost (Eng.)Type=Baseline, Features=36 hand-crafted protocol features2026.07 | 0.604 | 74.4 | 63.9 | 75.2 | 72.1 | |
| LightGBM (Eng.)Type=Baseline, Features=36 hand-crafted protocol features2026.07 | 0.603 | 75.1 | 64.6 | 74.6 | 71.1 | |
| GraphCodeBERTType=Transformer2026.07 | 0.595 | 75.4 | 65 | 78.1 | 71.5 | |
| DistilBERTType=Transformer2026.07 | 0.573 | 75.2 | 64.2 | 81 | 71.8 | |
| Hyb. DistilBERT+NumType=Hybrid2026.07 | 0.57 | 76.4 | 66.2 | 79.1 | 71.1 | |
| ModernBERTType=Transformer2026.07 | 0.568 | 74 | 61.8 | 79 | 70.4 | |
| BERT-baseType=Transformer2026.07 | 0.56 | 74.2 | 62.7 | 80.9 | 72.9 | |
| Hyb. ModernBERT+NumType=Hybrid2026.07 | 0.539 | 76.8 | 65.1 | 79.7 | 72.7 | |
| Hyb. CodeBERT+NumType=Hybrid2026.07 | 0.53 | 75 | 63.4 | 77.8 | 66.5 | |
| Hyb. GraphCB+NumType=Hybrid2026.07 | 0.522 | 74.7 | 63 | 74.1 | 70.6 | |
| ELECTRA-smallType=Transformer2026.07 | 0.509 | 73.7 | 60.8 | 76.8 | 64.8 | |
| CodeBERTType=Transformer2026.07 | 0.505 | 72.5 | 60.8 | 75.5 | 69.7 | |
| RoBERTaType=Transformer2026.07 | 0.493 | 72.4 | 60.2 | 77 | 70.6 | |
| XGBoost (TF-IDF)Type=Baseline-TF2026.07 | 0.462 | 73.3 | 60.3 | 80.4 | 66.4 | |
| LightGBM (TF-IDF)Type=Baseline-TF2026.07 | 0.429 | 71.8 | 58 | 78.3 | 64.9 |