Failure Detection on LIZ-SG
0.37E-AURCAQA
Evaluation Results
| Method | Links | |
|---|---|---|
| AQAUncertainty Method=MCD, Aggregation parameter=.752026.03 | 0.37 | |
| ICAUncertainty Method=MCD2026.03 | 0.36 | |
| AVGUncertainty Method=MCD2026.03 | 0.36 | |
| AQAUncertainty Method=MCD, Aggregation parameter=.62026.03 | 0.36 | |
| ICAUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.36 | |
| AQAThreshold=0.9, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.36 | |
| AVGUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.36 | |
| AQAThreshold=0.75, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.36 | |
| AQAUncertainty Method=MCD, Aggregation parameter=.92026.03 | 0.35 | |
| BCAUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.35 | |
| AQAThreshold=0.6, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.35 | |
| PLMUncertainty Method=MCD, Aggregation parameter=502026.03 | 0.34 | |
| BCAUncertainty Method=MCD2026.03 | 0.33 | |
| PLMUncertainty Method=MCD, Aggregation parameter=202026.03 | 0.33 | |
| QFRUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.32 | |
| PLMParameter=50, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.32 | |
| PLMParameter=20, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.31 | |
| PLMUncertainty Method=MCD, Aggregation parameter=102026.03 | 0.3 | |
| ATAThreshold=0.3, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.3 | |
| ATAThreshold=0.5, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.29 | |
| PLMParameter=10, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.29 | |
| ATAThreshold=0.7, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.29 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.32026.03 | 0.28 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.52026.03 | 0.28 | |
| QFRUncertainty Method=MCD2026.03 | 0.27 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.72026.03 | 0.25 | |
| GMM-SpaUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.24 | |
| GMM-IntUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.22 | |
| GMM-AllUncertainty Method=MCD2026.03 | 0.21 | |
| GMM-AllUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.21 | |
| GMM-IntUncertainty Method=MCD2026.03 | 0.2 | |
| GMM-SpaUncertainty Method=MCD2026.03 | 0.2 |