IoT Firmware Version Change Identification on IoT Firmware Dataset (test)
68.75Result 1Twin Neural Network
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Twin Neural NetworkAccuracy Measurement Method=Hedges’ g2025.01 | 68.75 | 65.63 | 84.38 | 75 | 75 | 62.5 | 65.63 | 62.5 | 81.25 | 71.88 | 71.25 | |
| Twin Neural NetworkAccuracy Measurement Method=Mean Threshold2025.01 | 34.38 | 25 | 25 | 46.88 | 25 | 34.38 | 50 | 37.5 | 46.88 | 28.13 | 35.31 | |
| Twin Neural NetworkAccuracy Measurement Method=All Samples2025.01 | 32 | 27.16 | 29.29 | 44.12 | 31.06 | 35.63 | 48.18 | 31.2 | 45.08 | 37.59 | 36.13 | |
| Twin Neural NetworkAccuracy Measurement Method=Majority Samples2025.01 | 25 | 25 | 25 | 40.63 | 25 | 34.38 | 50 | 37.5 | 46.88 | 28.13 | 33.75 |