Failure Detection on ARC-Nuc
0.05E-AURCATA
Evaluation results
| Method | Links | |
|---|---|---|
| ATAThreshold=0.7, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.05 | |
| GMM-SpaType=Ensembling heatmaps2026.03 | 0.04 | |
| GMM-IntType=Ensembling heatmaps2026.03 | 0.04 | |
| AQAType=Ensembling heatmaps, threshold=.62026.03 | 0.04 | |
| AVGType=Ensembling heatmaps2026.03 | 0.04 | |
| ICAType=Ensembling heatmaps2026.03 | 0.04 | |
| GMM-SpaUncertainty Method=MCD2026.03 | 0.04 | |
| ICAUncertainty Method=MCD2026.03 | 0.04 | |
| AVGUncertainty Method=MCD2026.03 | 0.04 | |
| AQAUncertainty Method=MCD, Aggregation parameter=.62026.03 | 0.04 | |
| GMM-IntUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| GMM-SpaUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| ICAUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| AQAThreshold=0.6, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| AVGUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| AQAThreshold=0.75, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.04 | |
| GMM-AllType=Ensembling heatmaps2026.03 | 0.03 | |
| BCAType=Ensembling heatmaps2026.03 | 0.03 | |
| PLMType=Ensembling heatmaps, value=202026.03 | 0.03 | |
| ATAType=Ensembling heatmaps, threshold=.32026.03 | 0.03 | |
| AQAType=Ensembling heatmaps, threshold=.92026.03 | 0.03 | |
| PLMType=Ensembling heatmaps, value=502026.03 | 0.03 | |
| AQAType=Ensembling heatmaps, threshold=.752026.03 | 0.03 | |
| GMM-AllUncertainty Method=MCD2026.03 | 0.03 | |
| GMM-IntUncertainty Method=MCD2026.03 | 0.03 | |
| BCAUncertainty Method=MCD2026.03 | 0.03 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.32026.03 | 0.03 | |
| PLMUncertainty Method=MCD, Aggregation parameter=102026.03 | 0.03 | |
| PLMUncertainty Method=MCD, Aggregation parameter=502026.03 | 0.03 | |
| AQAUncertainty Method=MCD, Aggregation parameter=.92026.03 | 0.03 | |
| AQAUncertainty Method=MCD, Aggregation parameter=.752026.03 | 0.03 | |
| GMM-AllUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.03 | |
| ATAThreshold=0.3, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.03 | |
| PLMParameter=20, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.03 | |
| PLMParameter=10, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.03 | |
| PLMParameter=50, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.03 | |
| AQAThreshold=0.9, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.03 | |
| QFRType=Ensembling heatmaps2026.03 | 0.02 | |
| PLMType=Ensembling heatmaps, value=102026.03 | 0.02 | |
| ATAType=Ensembling heatmaps, threshold=.52026.03 | 0.02 | |
| QFRUncertainty Method=MCD2026.03 | 0.02 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.52026.03 | 0.02 | |
| PLMUncertainty Method=MCD, Aggregation parameter=202026.03 | 0.02 | |
| ATAUncertainty Method=MCD, Aggregation parameter=.72026.03 | 0.02 | |
| QFRUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.02 | |
| BCAUncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.02 | |
| ATAThreshold=0.5, Uncertainty Framework=Maximum Softmax Probability (MSP)2026.03 | 0.02 | |
| ATAType=Ensembling heatmaps, threshold=.72026.03 | 0.01 |