Failure Detection on LIZ-SG (AUROC)
0.79AUROCAQA
Evaluation Results
| Method | Links | |
|---|---|---|
| AQAUncertainty Framework=MSP, Threshold=0.92026.03 | 0.79 | |
| AVGUncertainty Framework=MSP2026.03 | 0.78 | |
| AQAUncertainty Framework=MSP, Threshold=0.752026.03 | 0.78 | |
| AQAUncertainty Framework=MSP, Threshold=0.62026.03 | 0.77 | |
| BCAUncertainty Framework=MSP2026.03 | 0.73 | |
| QFRUncertainty Framework=MSP2026.03 | 0.71 | |
| PLMUncertainty Framework=MSP, Parameter=502026.03 | 0.69 | |
| PLMUncertainty Framework=MSP, Parameter=202026.03 | 0.68 | |
| ICAUncertainty Framework=MSP2026.03 | 0.66 | |
| ATAUncertainty Framework=MSP, Threshold=0.72026.03 | 0.64 | |
| ATAUncertainty Framework=MSP, Threshold=0.52026.03 | 0.63 | |
| ATAUncertainty Framework=MSP, Threshold=0.32026.03 | 0.61 | |
| PLMUncertainty Framework=MSP, Parameter=102026.03 | 0.59 | |
| GMM-SpaUncertainty Framework=MSP2026.03 | 0.52 | |
| GMM-IntUncertainty Framework=MSP2026.03 | 0.46 | |
| GMM-AllUncertainty Framework=MSP2026.03 | 0.45 |