# Out-of-distribution Detection on SVHN (ID) vs LSUN (OOD) (test) Source: [Out-of-distribution Detection on SVHN (ID) vs LSUN (OOD) (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:05:54.748Z Evaluation of Out-of-Distribution Detection performance where SVHN serves as the in-distribution dataset and LSUN serves as the out-of-distribution dataset, evaluated on the test split. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Out-of-distribution Detection | | Dataset (including any stated split) | SVHN in-distribution LSUN out-of-distribution (test) | | Metric | TNR @ TPR 95% | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 34 of 34 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [TNR @ TPR 95%](): Higher is better; unit: PERCENT. - [AUROC](): Higher is better; unit: PERCENT. - [Detection Accuracy](): Higher is better; unit: PERCENT. - [AUPR (in)](): Higher is better; unit: PERCENT. - [AUPR (out)](): Higher is better; unit: PERCENT. ## Recorded results | Method | TNR @ TPR 95% | Result date | Report paper | | --- | --- | --- | --- | | Mahalanobis distance-based score | 100 | Not recorded | 68fa64f91e209131cea077ac | | Mahalanobis distance-based score | 100 | Not recorded | 68fa64f91e209131cea077ac | | Mahalanobis | 100 | Not recorded | 68fa64f91e209131cea077ac | | Mahalanobis distance-based score | 99.9 | Not recorded | 68fa64f91e209131cea077ac | | Mahalanobis distance-based score | 99.9 | Not recorded | 68fa64f91e209131cea077ac | | Mahalanobis | 99.9 | Not recorded | 68fa64f91e209131cea077ac | | Mahalanobis | 99.9 | Not recorded | 68fa66e31e209131cea12d95 | | Mahalanobis | 99.9 | Not recorded | 68fa66e31e209131cea12d95 | | Mahalanobis | 99.9 | Not recorded | 68fa66e31e209131cea12d95 | | Mahalanobis | 99.9 | Not recorded | 68fa66e31e209131cea12d95 | | Ours | 99.6 | Not recorded | 68fa66e31e209131cea12d95 | | Ours | 99.6 | Not recorded | 68fa66e31e209131cea12d95 | | Ours | 99.5 | Not recorded | 68fa66e31e209131cea12d95 | | Ours | 99.5 | Not recorded | 68fa66e31e209131cea12d95 | | ODIN | 81.1 | Not recorded | 68fa64f91e209131cea077ac | | ODIN | 81.1 | Not recorded | 68fa64f91e209131cea077ac | | ODIN | 81.1 | Not recorded | 68fa66e31e209131cea12d95 | | ODIN | 81.1 | Not recorded | 68fa66e31e209131cea12d95 | | ODIN | 77.3 | Not recorded | 68fa64f91e209131cea077ac | | ODIN | 77.3 | Not recorded | 68fa64f91e209131cea077ac | | ODIN | 77.3 | Not recorded | 68fa66e31e209131cea12d95 | | ODIN | 77.3 | Not recorded | 68fa66e31e209131cea12d95 | | Baseline | 77.1 | Not recorded | 68fa64f91e209131cea077ac | | Baseline | 77.1 | Not recorded | 68fa64f91e209131cea077ac | | ODIN | 77.1 | Not recorded | 68fa64f91e209131cea077ac | | Baseline | 77.1 | Not recorded | 68fa64f91e209131cea077ac | | Baseline | 77.1 | Not recorded | 68fa66e31e209131cea12d95 | | Baseline | 77.1 | Not recorded | 68fa66e31e209131cea12d95 | | ODIN | 76.3 | Not recorded | 68fa64f91e209131cea077ac | | Baseline | 74.3 | Not recorded | 68fa64f91e209131cea077ac | | Baseline | 74.3 | Not recorded | 68fa64f91e209131cea077ac | | Baseline | 74.3 | Not recorded | 68fa64f91e209131cea077ac | | Baseline | 74.3 | Not recorded | 68fa66e31e209131cea12d95 | | Baseline | 74.3 | Not recorded | 68fa66e31e209131cea12d95 | ### Mahalanobis distance-based score TNR @ TPR 95%: 100. Result ID: 698c95c70b614d12cff1c077. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet","Validation Setup":"OOD samples"}. This record does not assert independent reproduction. ### Mahalanobis distance-based score TNR @ TPR 95%: 100. Result ID: 698c95c70b614d12cff1c07a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet","Validation Setup":"adversarial samples"}. This record does not assert independent reproduction. ### Mahalanobis TNR @ TPR 95%: 100. Result ID: 698c95c70b614d12cff1c0b3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet"}. This record does not assert independent reproduction. ### Mahalanobis distance-based score TNR @ TPR 95%: 99.9. Result ID: 698c95c70b614d12cff1c07d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet","Validation Setup":"OOD samples"}. This record does not assert independent reproduction. ### Mahalanobis distance-based score TNR @ TPR 95%: 99.9. Result ID: 698c95c70b614d12cff1c080. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet","Validation Setup":"adversarial samples"}. This record does not assert independent reproduction. ### Mahalanobis TNR @ TPR 95%: 99.9. Result ID: 698c95c70b614d12cff1c0b6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction. ### Mahalanobis TNR @ TPR 95%: 99.9. Result ID: 698d0e468b517eb4331ea818. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet"}. This record does not assert independent reproduction. ### Mahalanobis TNR @ TPR 95%: 99.9. Result ID: 698d0e468b517eb4331ea81c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction. ### Mahalanobis TNR @ TPR 95%: 99.9. Result ID: 698d0e468b517eb4331ea8ba. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"DenseNet"}. This record does not assert independent reproduction. ### Mahalanobis TNR @ TPR 95%: 99.9. Result ID: 698d0e468b517eb4331ea8be. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"ResNet"}. This record does not assert independent reproduction. ### Ours TNR @ TPR 95%: 99.6. Result ID: 698d0e468b517eb4331ea81d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction. ### Ours TNR @ TPR 95%: 99.6. Result ID: 698d0e468b517eb4331ea8bf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"ResNet"}. This record does not assert independent reproduction. ### Ours TNR @ TPR 95%: 99.5. Result ID: 698d0e468b517eb4331ea819. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet"}. This record does not assert independent reproduction. ### Ours TNR @ TPR 95%: 99.5. Result ID: 698d0e468b517eb4331ea8bb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"DenseNet"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 81.1. Result ID: 698c95c70b614d12cff1c076. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DenseNet","Validation Setup":"OOD samples"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 81.1. Result ID: 698c95c70b614d12cff1c0b2. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DenseNet"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 81.1. Result ID: 698d0e468b517eb4331ea817. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 81.1. Result ID: 698d0e468b517eb4331ea8b9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"DenseNet"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 77.3. Result ID: 698c95c70b614d12cff1c07c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Validation Setup":"OOD samples"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 77.3. Result ID: 698c95c70b614d12cff1c0b5. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 77.3. Result ID: 698d0e468b517eb4331ea81b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 77.3. Result ID: 698d0e468b517eb4331ea8bd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"ResNet"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 77.1. Result ID: 698c95c70b614d12cff1c075. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet","Validation Setup":"OOD samples"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 77.1. Result ID: 698c95c70b614d12cff1c078. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet","Validation Setup":"adversarial samples"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 77.1. Result ID: 698c95c70b614d12cff1c079. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DenseNet","Validation Setup":"adversarial samples"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 77.1. Result ID: 698c95c70b614d12cff1c0b1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 77.1. Result ID: 698d0e468b517eb4331ea816. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DenseNet"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 77.1. Result ID: 698d0e468b517eb4331ea8b8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"DenseNet"}. This record does not assert independent reproduction. ### ODIN TNR @ TPR 95%: 76.3. Result ID: 698c95c70b614d12cff1c07f. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet","Validation Setup":"adversarial samples"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 74.3. Result ID: 698c95c70b614d12cff1c07b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet","Validation Setup":"OOD samples"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 74.3. Result ID: 698c95c70b614d12cff1c07e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet","Validation Setup":"adversarial samples"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 74.3. Result ID: 698c95c70b614d12cff1c0b4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 74.3. Result ID: 698d0e468b517eb4331ea81a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction. ### Baseline TNR @ TPR 95%: 74.3. Result ID: 698d0e468b517eb4331ea8bc. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Architecture":"ResNet"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.