Failure Detection on LIZ-IG (AUROC)
0.77AUROCAVG
Evaluation results
| Method | Links | |
|---|---|---|
| AVGUncertainty Framework=MSP2026.03 | 0.77 | |
| AQAUncertainty Framework=MSP, Threshold=0.62026.03 | 0.77 | |
| AQAUncertainty Framework=MSP, Threshold=0.752026.03 | 0.77 | |
| AQAUncertainty Framework=MSP, Threshold=0.92026.03 | 0.76 | |
| QFRUncertainty Framework=MSP2026.03 | 0.73 | |
| ICAUncertainty Framework=MSP2026.03 | 0.7 | |
| PLMUncertainty Framework=MSP, Parameter=502026.03 | 0.69 | |
| PLMUncertainty Framework=MSP, Parameter=202026.03 | 0.68 | |
| BCAUncertainty Framework=MSP2026.03 | 0.66 | |
| PLMUncertainty Framework=MSP, Parameter=102026.03 | 0.66 | |
| ATAUncertainty Framework=MSP, Threshold=0.32026.03 | 0.6 | |
| GMM-AllUncertainty Framework=MSP2026.03 | 0.55 | |
| GMM-IntUncertainty Framework=MSP2026.03 | 0.52 | |
| ATAUncertainty Framework=MSP, Threshold=0.52026.03 | 0.52 | |
| GMM-SpaUncertainty Framework=MSP2026.03 | 0.51 | |
| ATAUncertainty Framework=MSP, Threshold=0.72026.03 | 0.5 |