Cybersecurity Testbed Evaluation on State-of-the-Art Cybersecurity Testbeds
60# AttacksNetSecBed
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| NetSecBedScientific Contributions=Reproducible attack pipeline; structured attack catalog; feature extraction; observability and extensibility by design, Main Limitations=External threat focus; no firmware/CVE-specific or industrial protocol attacks2026.04 | 60 | — | — | — | |
| GothamScientific Contributions=Reproducible IoT testbed; multi-protocol support; real dataset generation, Main Limitations=Restricted service scope; limited device diversity; no MITRE ATT&CK mapping2026.04 | 18 | 140 | — | — | |
| IoT Security TestbedScientific Contributions=Open-source automated vulnerability assessment platform for IoT devices, Main Limitations=Few attacks; minimal scalability; no native IoT protocols or MITRE mapping2026.04 | 13 | 1 | — | — | |
| QR-GridExScientific Contributions=HIL-based large-scale coordinated attack simulation for smart grids, Main Limitations=Limited attack catalog; low reproducibility; energy-specific scope2026.04 | 10 | — | 3 | — | |
| RESLabScientific Contributions=Security experimentation and dataset collection, Main Limitations=Very limited attack diversity; single-protocol scope; no MITRE mapping2026.04 | 4 | 50 | 3 | 3 | |
| CPS MicrogridScientific Contributions=Real-time co-simulation for CPS attack impact analysis, Main Limitations=Low scalability; protocol limitations; proprietary hardware dependence2026.04 | 3 | — | 61,850 | — | |
| LoRaWAN MitMScientific Contributions=LPWAN security testbed for real over-the-air experiments, Main Limitations=Very limited attack coverage; radio-dependent; unrealistic assumptions2026.04 | 2 | — | 1 | — | |
| Lightweight SCADAScientific Contributions=Traffic generation and attack collection for SCADA security datasets, Main Limitations=Only two attacks; single-protocol scope; no quantitative metrics or MITRE mapping2026.04 | 2 | — | — | — |