Failure Detection on WORM-Pro
13E-AURCAQA
Evaluation Results
| Method | Links | |
|---|---|---|
| AQAUncertainty Method=MCD, Aggregation parameter=.92026.03 | 13 | |
| AQAUncertainty Method=MCD, Aggregation parameter=.752026.03 | 13 | |
| AQAUncertainty Method=MCD, Aggregation parameter=.62026.03 | 13 | |
| AVGUncertainty Method=MCD2026.03 | 12 | |
| BCAUncertainty Method=MCD2026.03 | 9 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.32026.03 | 9 | |
| ICAUncertainty Method=MCD2026.03 | 9 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.52026.03 | 8 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.72026.03 | 8 | |
| GMM-SpaUncertainty Method=MCD2026.03 | 7 | |
| PLMUncertainty Method=MCD, Aggregation parameter=502026.03 | 7 | |
| GMM-AllUncertainty Method=MCD2026.03 | 6 | |
| GMM-IntUncertainty Method=MCD2026.03 | 6 | |
| PLMUncertainty Method=MCD, Aggregation parameter=202026.03 | 6 | |
| PLMUncertainty Method=MCD, Aggregation parameter=102026.03 | 5 | |
| QFRUncertainty Method=MCD2026.03 | 4 | |
| AQAThreshold=0.9, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.09 | |
| AQAThreshold=0.75, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.09 | |
| ATAThreshold=0.7, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.09 | |
| ATAThreshold=0.5, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.08 | |
| ATAThreshold=0.3, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.08 | |
| AQAThreshold=0.6, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.08 | |
| AVGUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.08 | |
| BCAUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.07 | |
| GMM-SpaUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.07 | |
| ICAUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.07 | |
| PLMParameter=50, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.06 | |
| PLMParameter=20, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.05 | |
| PLMParameter=10, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.05 | |
| GMM-AllUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| QFRUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| GMM-IntUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 |