Crash Detection on Firmware Targets Various Suite
1Crash CountFuzzware
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=21-3320 [26]2026.05 | 1 | 2 | — | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(UART), Vulnerability=21-3329 [27]2026.05 | 1 | 35 | 1.41 | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=BLE-HCI, Vulnerability=NPD-ull conn.2026.05 | 1 | 8 | 6.04 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=OOB-decode.2026.05 | 1 | 8 | 6 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(UART), Vulnerability=NPD-net_buf_simple.2026.05 | 1 | 5 | 8.23 | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=20-10064 [22]2026.05 | 2 | 10 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=GPSTracker, Vulnerability=NPD-strstr_xx [12]2026.05 | 2 | 9 | — | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Snmp Server, Vulnerability=20-12141 [39]2026.05 | 2 | 6 | 1.41 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=CCN-Lite-Relay, Vulnerability=NPD-ccnl [8]2026.05 | 2 | 18 | 2.69 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=GPSTracker, Vulnerability=NPD-strstr_xx [11]2026.05 | 3 | 5 | 9.6 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=GPSTracker, Vulnerability=NPD-strstr_xx [12]2026.05 | 3 | 5 | 1.72 | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Snmp Server, Vulnerability=20-12141 [39]2026.05 | 3 | 8 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=SocketCan, Vulnerability=NPD-pwm_shell2026.05 | 3 | 17 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=CCN-Lite-Relay, Vulnerability=NPD-evtimer [9]2026.05 | 4 | 9 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=GPSTracker, Vulnerability=NPD-strtok_xx [10]2026.05 | 5 | 2 | — | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=GPSTracker, Vulnerability=NPD-strtok_xx [10]2026.05 | 5 | 1 | 1.38 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=NPD-processSysex.2026.05 | 5 | 6 | 7.38 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=L2cap Processor, Vulnerability=20-12140 [38]2026.05 | 5 | 0 | 57 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=CCN-Lite-Relay, Vulnerability=NPD-evtimer [9]2026.05 | 5 | 6 | 1.59 | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC15 [45]2026.05 | 6 | 0 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC16 [46]2026.05 | 6 | 0 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=ING-Sysex. [6]2026.05 | 6 | 0 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=SocketCan, Vulnerability=NPD-net_pkt [14]2026.05 | 6 | 16 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [47]2026.05 | 7 | 4 | — | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=20-10064 [22]2026.05 | 8 | 11 | 0.92 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=ING-Sysex. [6]2026.05 | 8 | 0 | 0.68 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=UPD-TxCplt [41]2026.05 | 8 | 0 | 1 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=SocketCan, Vulnerability=NPD-net_pkt [14]2026.05 | 8 | 12 | 1.28 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC15 [45]2026.05 | 9 | 0 | 10.27 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=SocketCan, Vulnerability=NPD-pwm_shell2026.05 | 9 | 5 | 3.45 | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=UPD-TxCplt [41]2026.05 | 10 | 0 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(SPI), Vulnerability=20-10065 [23]2026.05 | 10 | 0 | — | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(SPI), Vulnerability=20-10066 [24]2026.05 | 15 | 5 | — | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [47]2026.05 | 15 | 4 | 1.05 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(SPI), Vulnerability=20-10065 [23]2026.05 | 15 | 0 | 4.44 | |
| SEmu + FIDOBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [47]2026.05 | 17 | 1 | 24 | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=21-3320 [26]2026.05 | 18 | 3 | 0.69 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC16 [46]2026.05 | 20 | 0 | 1.07 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=OOB-setPin. [40]2026.05 | 20 | 0 | 1.43 | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=CCN-Lite-Relay, Vulnerability=RC-ble_isr [13]2026.05 | 20 | 0 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=CCN-Lite-Relay, Vulnerability=UAF-ccnl_xx [15]2026.05 | 20 | 3 | — | |
| SEmuBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=Heat Press, Vulnerability=OOB-FC1 [44]2026.05 | 24 | 3 | — | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=CCN-Lite-Relay, Vulnerability=RC-ble_isr [13]2026.05 | 25 | 0 | 0.68 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=CCN-Lite-Relay, Vulnerability=UAF-ccnl_xx [15]2026.05 | 28 | 1 | 2.11 | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=OOB-setPin. [40]2026.05 | 30 | 0 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gattupdate*, Vulnerability=24-220952026.05 | 40 | 7 | — | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gattupdate*, Vulnerability=24-220952026.05 | 43 | 0 | 28.79 | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(SPI), Vulnerability=20-10065 [23]2026.05 | 66 | 7 | — | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [47]2026.05 | 68 | 5 | — | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC16 [46]2026.05 | 88 | 1 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=20-10064 [22]2026.05 | 90 | 3 | — | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC1 [44]2026.05 | 91 | 0 | — | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=20-10064 [22]2026.05 | 95 | 1 | 2.08 | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=NPD-pwm_start [42]2026.05 | 97 | 0 | — | |
| SEmuBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=PLC, Vulnerability=OOB-FC16 [46]2026.05 | 100 | 1 | — | |
| SEmu + FIDOBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=Heat Press, Vulnerability=OOB-FC1 [44]2026.05 | 112 | 0 | 4.58 | |
| MultiFuzzBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [43]2026.05 | 127 | 0 | — | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [47]2026.05 | 129 | 4 | 1.06 | |
| SEmuBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=PLC, Vulnerability=OOB-FC15 [45]2026.05 | 135 | 0 | — | |
| SEmu + FIDOBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [43]2026.05 | 175 | 0 | 302 | |
| SEmu + FIDOBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=PLC, Vulnerability=OOB-FC15 [45]2026.05 | 175 | 0 | 1.62 | |
| SEmu + FIDOBase Fuzzer=SEmu, Original Configuration=MSP, Firmware Target=PLC, Vulnerability=OOB-FC16 [46]2026.05 | 185 | 0 | 3.35 | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(SPI), Vulnerability=20-10066 [24]2026.05 | 225 | 3 | 1.41 | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC15 [45]2026.05 | 244 | 0 | — | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC1 [44]2026.05 | 258 | 0 | — | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [43]2026.05 | 302 | 0 | 3.36 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC1 [44]2026.05 | 374 | 0 | 2.05 | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC15 [45]2026.05 | 385 | 0 | 1.05 | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC1 [44]2026.05 | 399 | 0 | 0.92 | |
| MultiFuzz + FIDOBase Fuzzer=MultiFuzz, Original Configuration=Better of RR and Fuzz, Firmware Target=Gateway, Vulnerability=NPD-pwm_start [42]2026.05 | 764 | 0 | 1.32 | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Bootstrap(SPI), Vulnerability=20-10065 [23]2026.05 | 774 | 0 | 64.23 | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [43]2026.05 | 1,236 | 0 | — | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=PLC, Vulnerability=OOB-FC16 [46]2026.05 | 1,329 | 0 | 4.15 | |
| FuzzwareBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=21-3319 [25]2026.05 | 1,590 | 0 | — | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Echo Server, Vulnerability=21-3319 [25]2026.05 | 1,620 | 0 | 1.09 | |
| Fuzzware + FIDOBase Fuzzer=Fuzzware, Original Configuration=Better of RR and Fuzz, Firmware Target=Heat Press, Vulnerability=OOB-FC3 [43]2026.05 | 1,765 | 0 | 2.83 |