# Cybersecurity Testbed Evaluation on State-of-the-Art Cybersecurity Testbeds

Source: [Cybersecurity Testbed Evaluation on State-of-the-Art Cybersecurity Testbeds](<https://www.sota2.com/research/sota/cybersecurity-testbed-evaluation-on-state-of-the-art-cybersecurity-testbeds>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T09:51:47.083Z

Evaluation of cybersecurity testbed environments focusing on operational metrics such as scalability, supported protocols, attack surface (#Atk), and targeted services.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Cybersecurity Testbed Evaluation |
| Dataset (including any stated split) | State-of-the-Art Cybersecurity Testbeds |
| Metric | # Attacks |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [# Attacks](<https://www.sota2.com/research/sota/cybersecurity-testbed-evaluation-on-state-of-the-art-cybersecurity-testbeds.md?metric=%23%20Attacks>): Higher is better; unit: SCALAR.

- [Scalability](<https://www.sota2.com/research/sota/cybersecurity-testbed-evaluation-on-state-of-the-art-cybersecurity-testbeds.md?metric=Scalability>): Higher is better; unit: SCALAR.

- [Protocol Support Count](<https://www.sota2.com/research/sota/cybersecurity-testbed-evaluation-on-state-of-the-art-cybersecurity-testbeds.md?metric=Protocol%20Support%20Count>): Higher is better; unit: SCALAR.

- [Targeted Services Count](<https://www.sota2.com/research/sota/cybersecurity-testbed-evaluation-on-state-of-the-art-cybersecurity-testbeds.md?metric=Targeted%20Services%20Count>): Higher is better; unit: SCALAR.

## Recorded results

| Method | # Attacks | Result date | Report paper |
| --- | --- | --- | --- |
| NetSecBed | 60 | Not recorded | 69d48fd77d0172140ec74671 |
| Gotham | 18 | Not recorded | 69d48fd77d0172140ec74671 |
| IoT Security Testbed | 13 | Not recorded | 69d48fd77d0172140ec74671 |
| QR-GridEx | 10 | Not recorded | 69d48fd77d0172140ec74671 |
| RESLab | 4 | Not recorded | 69d48fd77d0172140ec74671 |
| CPS Microgrid | 3 | Not recorded | 69d48fd77d0172140ec74671 |
| LoRaWAN MitM | 2 | Not recorded | 69d48fd77d0172140ec74671 |
| Lightweight SCADA | 2 | Not recorded | 69d48fd77d0172140ec74671 |

### NetSecBed

# Attacks: 60. Result ID: 69d4d3b047f34ce924bd0d1f.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

Recorded evaluation configuration: {"Scientific Contributions":"Reproducible attack pipeline; structured attack catalog; feature extraction; observability and extensibility by design","Main Limitations":"External threat focus; no firmware/CVE-specific or industrial protocol attacks"}. This record does not assert independent reproduction.

### Gotham

# Attacks: 18. Result ID: 69d4d3b047f34ce924bd0d18.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70291e209131cea497d5.md>)

Recorded evaluation configuration: {"Scientific Contributions":"Reproducible IoT testbed; multi-protocol support; real dataset generation","Main Limitations":"Restricted service scope; limited device diversity; no MITRE ATT&CK mapping"}. This record does not assert independent reproduction.

### IoT Security Testbed

# Attacks: 13. Result ID: 69d4d3b047f34ce924bd0d1a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

Recorded evaluation configuration: {"Scientific Contributions":"Open-source automated vulnerability assessment platform for IoT devices","Main Limitations":"Few attacks; minimal scalability; no native IoT protocols or MITRE mapping"}. This record does not assert independent reproduction.

### QR-GridEx

# Attacks: 10. Result ID: 69d4d3b047f34ce924bd0d1d.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

Recorded evaluation configuration: {"Scientific Contributions":"HIL-based large-scale coordinated attack simulation for smart grids","Main Limitations":"Limited attack catalog; low reproducibility; energy-specific scope"}. This record does not assert independent reproduction.

### RESLab

# Attacks: 4. Result ID: 69d4d3b047f34ce924bd0d19.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c001e209131cea3196b.md>)

Recorded evaluation configuration: {"Scientific Contributions":"Security experimentation and dataset collection","Main Limitations":"Very limited attack diversity; single-protocol scope; no MITRE mapping"}. This record does not assert independent reproduction.

### CPS Microgrid

# Attacks: 3. Result ID: 69d4d3b047f34ce924bd0d1c.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

Recorded evaluation configuration: {"Scientific Contributions":"Real-time co-simulation for CPS attack impact analysis","Main Limitations":"Low scalability; protocol limitations; proprietary hardware dependence"}. This record does not assert independent reproduction.

### LoRaWAN MitM

# Attacks: 2. Result ID: 69d4d3b047f34ce924bd0d1b.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

Recorded evaluation configuration: {"Scientific Contributions":"LPWAN security testbed for real over-the-air experiments","Main Limitations":"Very limited attack coverage; radio-dependent; unrealistic assumptions"}. This record does not assert independent reproduction.

### Lightweight SCADA

# Attacks: 2. Result ID: 69d4d3b047f34ce924bd0d1e.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd77d0172140ec74671.md>)

Recorded evaluation configuration: {"Scientific Contributions":"Traffic generation and attack collection for SCADA security datasets","Main Limitations":"Only two attacks; single-protocol scope; no quantitative metrics or MITRE mapping"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
