Runtime Safety Monitoring on Crossroad
7.47q_phirolling prediction monitor
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| rolling prediction monitorCalibration Level=Level-1, Specification=⊡[0,4] pf ∧ ⊡[0,4] pl, GT%=982026.05 | 7.47 | 5.6 | — | — | |
| Observer BaselineCalibration Level=Level-2, Specification=⊡[0,16] pf, GT%=1002026.05 | 6.68 | 36.2 | 100 | — | |
| rolling prediction monitorCalibration Level=Level-1, Specification=⊡[0,1] pf, GT%=1002026.05 | 6.67 | 53 | — | — | |
| rolling prediction monitorCalibration Level=Level-1, Specification=⊡[0,4] pf, GT%=1002026.05 | 6.67 | 49.1 | — | — | |
| rolling prediction monitorCalibration Level=Level-1, Specification=⊡[0,16] pf, GT%=1002026.05 | 6.67 | 36.2 | — | — | |
| rolling prediction monitorCalibration Level=Level-1, Specification=◇[0,4] pf, GT%=1002026.05 | 6.67 | 56.3 | — | — | |
| semantic-basis monitorCalibration Level=Level-1, Specification=⊡[0,4] pf ∧ ⊡[0,4] pl, GT%=982026.05 | 6.46 | 8.1 | — | — | |
| semantic-basis monitorCalibration Level=Level-1, Specification=◇[0,4] pf, GT%=1002026.05 | 5.89 | 57.6 | — | — | |
| semantic-basis monitorCalibration Level=Level-1, Specification=⊡[0,4] pf, GT%=1002026.05 | 5.82 | 49.8 | — | — | |
| semantic-basis monitorCalibration Level=Level-1, Specification=⊡[0,1] pf, GT%=1002026.05 | 5.78 | 54.2 | — | — | |
| Observer BaselineCalibration Level=Level-2, Specification=⊡[0,4] pf ∧ ⊡[0,4] pl, GT%=982026.05 | 5.62 | 12.5 | 99.9 | 10 | |
| semantic-basis monitorCalibration Level=Level-1, Specification=⊡[0,16] pf, GT%=1002026.05 | 5.61 | 36.5 | — | — | |
| Observer BaselineCalibration Level=Level-2, Specification=⊡[0,4] pf, GT%=1002026.05 | 3.76 | 55.9 | 100 | — | |
| Observer BaselineCalibration Level=Level-2, Specification=◇[0,4] pf, GT%=1002026.05 | 3.76 | 68.5 | 100 | — | |
| rolling prediction monitorCalibration Level=Level-2, Specification=⊡[0,16] pf, GT%=1002026.05 | 2.25 | 60 | 99.9 | — | |
| Observer BaselineCalibration Level=Level-2, Specification=⊡[0,1] pf, GT%=1002026.05 | 1.36 | 86.7 | 100 | — | |
| rolling prediction monitorCalibration Level=Level-2, Specification=⊡[0,4] pf ∧ ⊡[0,4] pl, GT%=982026.05 | 1.12 | 72.4 | 99.9 | 10 | |
| semantic-basis monitorCalibration Level=Level-2, Specification=⊡[0,4] pf ∧ ⊡[0,4] pl, GT%=982026.05 | 1 | 76.1 | 99.8 | 10 | |
| semantic-basis monitorCalibration Level=Level-2, Specification=⊡[0,16] pf, GT%=1002026.05 | 0.56 | 87.4 | 99.7 | — | |
| semantic-basis monitorCalibration Level=Level-2, Specification=⊡[0,4] pf, GT%=1002026.05 | 0.39 | 96.7 | 99.9 | — | |
| rolling prediction monitorCalibration Level=Level-2, Specification=⊡[0,4] pf, GT%=1002026.05 | 0.38 | 95.8 | 99.9 | — | |
| rolling prediction monitorCalibration Level=Level-2, Specification=◇[0,4] pf, GT%=1002026.05 | 0.38 | 99.9 | 100 | — | |
| semantic-basis monitorCalibration Level=Level-2, Specification=⊡[0,1] pf, GT%=1002026.05 | 0.33 | 98.9 | 99.9 | — | |
| semantic-basis monitorCalibration Level=Level-2, Specification=◇[0,4] pf, GT%=1002026.05 | 0.28 | 99.7 | 100 | — | |
| rolling prediction monitorCalibration Level=Level-2, Specification=⊡[0,1] pf, GT%=1002026.05 | 0.21 | 98.6 | 99.9 | — |