# Out-of-Distribution Detection on Aggregated OOD benchmark 308 experiments (test)

Source: [Out-of-Distribution Detection on Aggregated OOD benchmark 308 experiments (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-aggregated-ood-benchmark-308-experiments-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:48:30.199Z

Evaluation of Out-of-Distribution Detection performance on the specific test set derived from the aggregation of 308 experiments, reporting latency metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Out-of-Distribution Detection |
| Dataset (including any stated split) | Aggregated OOD benchmark 308 experiments (test) |
| Metric | Latency (s) |
| Unit | TIME |
| Direction | Lower is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Latency (s)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-aggregated-ood-benchmark-308-experiments-test.md?metric=Latency%20(s)>): Lower is better; unit: TIME.

## Recorded results

| Method | Latency (s) | Result date | Report paper |
| --- | --- | --- | --- |
| BinClass | 0.002 | Not recorded | 68fa6ee51e209131cea42b52 |
| PbThresh | 0.002 | Not recorded | 68fa6ee51e209131cea42b52 |
| ScoreSVM | 0.002 | Not recorded | 68fa6ee51e209131cea42b52 |
| Energy | 0.003 | Not recorded | 68fa6ee51e209131cea42b52 |
| Log.SVM | 0.003 | Not recorded | 68fa6ee51e209131cea42b52 |
| MC-Dropout | 0.003 | Not recorded | 68fa6ee51e209131cea42b52 |
| OutlierExposure | 0.003 | Not recorded | 68fa6ee51e209131cea42b52 |
| ReAct | 0.003 | Not recorded | 68fa6ee51e209131cea42b52 |
| ASH-B | 0.004 | Not recorded | 68fa6ee51e209131cea42b52 |
| Log.SVM | 0.006 | Not recorded | 68fa6ee51e209131cea42b52 |
| ScoreSVM | 0.006 | Not recorded | 68fa6ee51e209131cea42b52 |
| BinClass | 0.007 | Not recorded | 68fa6ee51e209131cea42b52 |
| MC-Dropout | 0.007 | Not recorded | 68fa6ee51e209131cea42b52 |
| PbThresh | 0.007 | Not recorded | 68fa6ee51e209131cea42b52 |
| Energy | 0.008 | Not recorded | 68fa6ee51e209131cea42b52 |
| OutlierExposure | 0.008 | Not recorded | 68fa6ee51e209131cea42b52 |
| ReAct | 0.008 | Not recorded | 68fa6ee51e209131cea42b52 |
| NAP | 0.008 | Not recorded | 68fa6ee51e209131cea42b52 |
| ASH-B | 0.009 | Not recorded | 68fa6ee51e209131cea42b52 |
| GradNorm | 0.01 | Not recorded | 68fa6ee51e209131cea42b52 |
| ODIN | 0.01 | Not recorded | 68fa6ee51e209131cea42b52 |
| DeepEns. | 0.012 | Not recorded | 68fa6ee51e209131cea42b52 |
| NAP | 0.015 | Not recorded | 68fa6ee51e209131cea42b52 |
| GradNorm | 0.027 | Not recorded | 68fa6ee51e209131cea42b52 |
| ODIN | 0.028 | Not recorded | 68fa6ee51e209131cea42b52 |
| OpenMax | 0.035 | Not recorded | 68fa6ee51e209131cea42b52 |
| DeepEns. | 0.038 | Not recorded | 68fa6ee51e209131cea42b52 |
| OpenMax | 0.04 | Not recorded | 68fa6ee51e209131cea42b52 |
| Mahalanobis | 0.086 | Not recorded | 68fa6ee51e209131cea42b52 |
| Mahalanobis | 0.217 | Not recorded | 68fa6ee51e209131cea42b52 |
| MeanShiftedAD | 0.231 | Not recorded | 68fa6ee51e209131cea42b52 |
| MeanShiftedAD | 0.314 | Not recorded | 68fa6ee51e209131cea42b52 |

### BinClass

Latency (s): 0.002. Result ID: 69907b043a6c31484900da73.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66361e209131cea0ed10.md>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### PbThresh

Latency (s): 0.002. Result ID: 69907b043a6c31484900da89.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### ScoreSVM

Latency (s): 0.002. Result ID: 69907b043a6c31484900da8d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### Energy

Latency (s): 0.003. Result ID: 69907b043a6c31484900da77.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69cc1e209131cea24242.md>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### Log.SVM

Latency (s): 0.003. Result ID: 69907b043a6c31484900da7b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66361e209131cea0ed10.md>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### MC-Dropout

Latency (s): 0.003. Result ID: 69907b043a6c31484900da7d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d31e209131ce9fb5ff.md>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### OutlierExposure

Latency (s): 0.003. Result ID: 69907b043a6c31484900da87.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa654c1e209131cea096af.md>)

[Implementation](<https://github.com/hendrycks/outlier-exposure>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### ReAct

Latency (s): 0.003. Result ID: 69907b043a6c31484900da8b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b4f1e209131cea2d8b5.md>)

[Implementation](<https://github.com/deeplearning-wisc/react.git>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### ASH-B

Latency (s): 0.004. Result ID: 69907b043a6c31484900da71.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f371e209131cea447f1.md>)

[Implementation](<https://andrijazz.github.io/ash>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### Log.SVM

Latency (s): 0.006. Result ID: 69907b043a6c31484900da7c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66361e209131cea0ed10.md>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### ScoreSVM

Latency (s): 0.006. Result ID: 69907b043a6c31484900da8e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### BinClass

Latency (s): 0.007. Result ID: 69907b043a6c31484900da74.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66361e209131cea0ed10.md>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### MC-Dropout

Latency (s): 0.007. Result ID: 69907b043a6c31484900da7e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d31e209131ce9fb5ff.md>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### PbThresh

Latency (s): 0.007. Result ID: 69907b043a6c31484900da8a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### Energy

Latency (s): 0.008. Result ID: 69907b043a6c31484900da78.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69cc1e209131cea24242.md>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### OutlierExposure

Latency (s): 0.008. Result ID: 69907b043a6c31484900da88.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa654c1e209131cea096af.md>)

[Implementation](<https://github.com/hendrycks/outlier-exposure>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### ReAct

Latency (s): 0.008. Result ID: 69907b043a6c31484900da8c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b4f1e209131cea2d8b5.md>)

[Implementation](<https://github.com/deeplearning-wisc/react.git>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### NAP

Latency (s): 0.008. Result ID: 69907b043a6c31484900da8f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Implementation](<https://github.com/safednn-group/nap-ood>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### ASH-B

Latency (s): 0.009. Result ID: 69907b043a6c31484900da72.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f371e209131cea447f1.md>)

[Implementation](<https://andrijazz.github.io/ash>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### GradNorm

Latency (s): 0.01. Result ID: 69907b043a6c31484900da79.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6afd1e209131cea2b8e2.md>)

[Implementation](<https://github.com/deeplearning-wisc/gradnorm_ood>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### ODIN

Latency (s): 0.01. Result ID: 69907b043a6c31484900da83.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa684a1e209131cea1b26f.md>)

[Implementation](<https://github.com/facebookresearch/odin>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### DeepEns.

Latency (s): 0.012. Result ID: 69907b043a6c31484900da75.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63bc1e209131cea0084f.md>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### NAP

Latency (s): 0.015. Result ID: 69907b043a6c31484900da90.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Implementation](<https://github.com/safednn-group/nap-ood>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### GradNorm

Latency (s): 0.027. Result ID: 69907b043a6c31484900da7a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6afd1e209131cea2b8e2.md>)

[Implementation](<https://github.com/deeplearning-wisc/gradnorm_ood>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### ODIN

Latency (s): 0.028. Result ID: 69907b043a6c31484900da84.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa684a1e209131cea1b26f.md>)

[Implementation](<https://github.com/facebookresearch/odin>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### OpenMax

Latency (s): 0.035. Result ID: 69907b043a6c31484900da85.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622a1e209131ce9f7cf0.md>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### DeepEns.

Latency (s): 0.038. Result ID: 69907b043a6c31484900da76.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63bc1e209131cea0084f.md>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### OpenMax

Latency (s): 0.04. Result ID: 69907b043a6c31484900da86.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622a1e209131ce9f7cf0.md>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### Mahalanobis

Latency (s): 0.086. Result ID: 69907b043a6c31484900da80.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64f91e209131cea077ac.md>)

[Implementation](<https://github.com/pokaxpoka/deep_Mahalanobis_detector>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

### Mahalanobis

Latency (s): 0.217. Result ID: 69907b043a6c31484900da7f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64f91e209131cea077ac.md>)

[Implementation](<https://github.com/pokaxpoka/deep_Mahalanobis_detector>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### MeanShiftedAD

Latency (s): 0.231. Result ID: 69907b043a6c31484900da81.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e0c1e209131cea3daa6.md>)

[Implementation](<https://github.com/talreiss/Mean-Shifted-Anomaly-Detection>)

Recorded evaluation configuration: {"Backbone":"VGG"}. This record does not assert independent reproduction.

### MeanShiftedAD

Latency (s): 0.314. Result ID: 69907b043a6c31484900da82.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee51e209131cea42b52.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e0c1e209131cea3daa6.md>)

[Implementation](<https://github.com/talreiss/Mean-Shifted-Anomaly-Detection>)

Recorded evaluation configuration: {"Backbone":"ResNet"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
