# Failure Detection on LIZ-IG (AUROC) Source: [Failure Detection on LIZ-IG (AUROC)]() Collection index: [llms.txt]() Data updated: 2026-04-01T08:55:34.721Z Evaluation of model performance on the LIZ-IG dataset for the Failure Detection task, specifically reporting the AUROC metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Failure Detection | | Dataset (including any stated split) | LIZ-IG | | Metric | AUROC | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AUROC](): Higher is better; unit: SCALAR. ## Recorded results | Method | AUROC | Result date | Report paper | | --- | --- | --- | --- | | AVG | 0.77 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.77 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.77 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | AQA | 0.76 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | QFR | 0.73 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ICA | 0.7 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.69 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.68 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | BCA | 0.66 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | PLM | 0.66 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.6 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-All | 0.55 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-Int | 0.52 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.52 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | GMM-Spa | 0.51 | Not recorded | 69cca6a90636e5bf4afcbcc5 | | ATA | 0.5 | Not recorded | 69cca6a90636e5bf4afcbcc5 | ### AVG AUROC: 0.77. Result ID: 69ccdd7347f34ce924b6b1cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP"}. This record does not assert independent reproduction. ### AQA AUROC: 0.77. Result ID: 69ccdd7347f34ce924b6b1d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Threshold":"0.6"}. This record does not assert independent reproduction. ### AQA AUROC: 0.77. Result ID: 69ccdd7347f34ce924b6b1d4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Threshold":"0.75"}. This record does not assert independent reproduction. ### AQA AUROC: 0.76. Result ID: 69ccdd7347f34ce924b6b1d2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Threshold":"0.9"}. This record does not assert independent reproduction. ### QFR AUROC: 0.73. Result ID: 69ccdd7347f34ce924b6b1cc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP"}. This record does not assert independent reproduction. ### ICA AUROC: 0.7. Result ID: 69ccdd7347f34ce924b6b1cb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP"}. This record does not assert independent reproduction. ### PLM AUROC: 0.69. Result ID: 69ccdd7347f34ce924b6b1d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Parameter":"50"}. This record does not assert independent reproduction. ### PLM AUROC: 0.68. Result ID: 69ccdd7347f34ce924b6b1d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Parameter":"20"}. This record does not assert independent reproduction. ### BCA AUROC: 0.66. Result ID: 69ccdd7347f34ce924b6b1ca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP"}. This record does not assert independent reproduction. ### PLM AUROC: 0.66. Result ID: 69ccdd7347f34ce924b6b1d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Parameter":"10"}. This record does not assert independent reproduction. ### ATA AUROC: 0.6. Result ID: 69ccdd7347f34ce924b6b1d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Threshold":"0.3"}. This record does not assert independent reproduction. ### GMM-All AUROC: 0.55. Result ID: 69ccdd7347f34ce924b6b1c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP"}. This record does not assert independent reproduction. ### GMM-Int AUROC: 0.52. Result ID: 69ccdd7347f34ce924b6b1cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP"}. This record does not assert independent reproduction. ### ATA AUROC: 0.52. Result ID: 69ccdd7347f34ce924b6b1d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Threshold":"0.5"}. This record does not assert independent reproduction. ### GMM-Spa AUROC: 0.51. Result ID: 69ccdd7347f34ce924b6b1ce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP"}. This record does not assert independent reproduction. ### ATA AUROC: 0.5. Result ID: 69ccdd7347f34ce924b6b1d8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Uncertainty Framework":"MSP","Threshold":"0.7"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.