# Failure Detection on LIZ-SG Source: [Failure Detection on LIZ-SG]() Collection index: [llms.txt]() Data updated: 2026-04-01T08:55:34.097Z Evaluation of model performance on the LIZ-SG dataset for the Failure Detection task, measured using E-AURC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Failure Detection | | Dataset (including any stated split) | LIZ-SG | | Metric | E-AURC | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [E-AURC](): Higher is better; unit: SCALAR. ## Recorded results | Method | E-AURC | Result date | Report paper | | --- | --- | --- | --- | | AQA | 0.37 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ICA | 0.36 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AVG | 0.36 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.36 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ICA | 0.36 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.36 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AVG | 0.36 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.36 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.35 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | BCA | 0.35 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.35 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.34 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | BCA | 0.33 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.33 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | QFR | 0.32 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.32 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.31 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.3 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.3 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.29 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.29 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.29 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.28 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.28 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | QFR | 0.27 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.25 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-Spa | 0.24 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-Int | 0.22 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-All | 0.21 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-All | 0.21 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-Int | 0.2 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-Spa | 0.2 | Not recorded | 69cca6a90636e5bf4afcbcc5 | ### AQA E-AURC: 0.37. Result ID: 69ccdd7347f34ce924b6afd6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":".75"}. This record does not assert independent reproduction. ### ICA E-AURC: 0.36. Result ID: 69ccdd7347f34ce924b6afd5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD"}. This record does not assert independent reproduction. ### AVG E-AURC: 0.36. Result ID: 69ccdd7347f34ce924b6afd7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD"}. This record does not assert independent reproduction. ### AQA E-AURC: 0.36. Result ID: 69ccdd7347f34ce924b6afd8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":".6"}. This record does not assert independent reproduction. ### ICA E-AURC: 0.36. Result ID: 69ccdd7347f34ce924b6b0d2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### AQA E-AURC: 0.36. Result ID: 69ccdd7347f34ce924b6b0d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Threshold":"0.9","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### AVG E-AURC: 0.36. Result ID: 69ccdd7347f34ce924b6b0d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### AQA E-AURC: 0.36. Result ID: 69ccdd7347f34ce924b6b0d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Threshold":"0.75","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### AQA E-AURC: 0.35. Result ID: 69ccdd7347f34ce924b6afd4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":".9"}. This record does not assert independent reproduction. ### BCA E-AURC: 0.35. Result ID: 69ccdd7347f34ce924b6b0cc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### AQA E-AURC: 0.35. Result ID: 69ccdd7347f34ce924b6b0d4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Threshold":"0.6","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### PLM E-AURC: 0.34. Result ID: 69ccdd7347f34ce924b6afd3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":"50"}. This record does not assert independent reproduction. ### BCA E-AURC: 0.33. Result ID: 69ccdd7347f34ce924b6afcd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD"}. This record does not assert independent reproduction. ### PLM E-AURC: 0.33. Result ID: 69ccdd7347f34ce924b6afd1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":"20"}. This record does not assert independent reproduction. ### QFR E-AURC: 0.32. Result ID: 69ccdd7347f34ce924b6b0ca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### PLM E-AURC: 0.32. Result ID: 69ccdd7347f34ce924b6b0d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameter":"50","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### PLM E-AURC: 0.31. Result ID: 69ccdd7347f34ce924b6b0d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameter":"20","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### PLM E-AURC: 0.3. Result ID: 69ccdd7347f34ce924b6afd0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":"10"}. This record does not assert independent reproduction. ### ATA E-AURC: 0.3. Result ID: 69ccdd7347f34ce924b6b0cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Threshold":"0.3","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### ATA E-AURC: 0.29. Result ID: 69ccdd7347f34ce924b6b0ce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Threshold":"0.5","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### PLM E-AURC: 0.29. Result ID: 69ccdd7347f34ce924b6b0d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameter":"10","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### ATA E-AURC: 0.29. Result ID: 69ccdd7347f34ce924b6b0d8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Threshold":"0.7","Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### ATA E-AURC: 0.28. Result ID: 69ccdd7347f34ce924b6afce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":".3"}. This record does not assert independent reproduction. ### ATA E-AURC: 0.28. Result ID: 69ccdd7347f34ce924b6afcf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":".5"}. This record does not assert independent reproduction. ### QFR E-AURC: 0.27. Result ID: 69ccdd7347f34ce924b6afc9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD"}. This record does not assert independent reproduction. ### ATA E-AURC: 0.25. Result ID: 69ccdd7347f34ce924b6afd2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD","Aggregation parameter":".7"}. This record does not assert independent reproduction. ### GMM-Spa E-AURC: 0.24. Result ID: 69ccdd7347f34ce924b6b0cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### GMM-Int E-AURC: 0.22. Result ID: 69ccdd7347f34ce924b6b0cb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### GMM-All E-AURC: 0.21. Result ID: 69ccdd7347f34ce924b6afca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD"}. This record does not assert independent reproduction. ### GMM-All E-AURC: 0.21. Result ID: 69ccdd7347f34ce924b6b0c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"Maximum Softmax Probability (MSP)"}. This record does not assert independent reproduction. ### GMM-Int E-AURC: 0.2. Result ID: 69ccdd7347f34ce924b6afcb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD"}. This record does not assert independent reproduction. ### GMM-Spa E-AURC: 0.2. Result ID: 69ccdd7347f34ce924b6afcc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Method":"MCD"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.