# Out-of-distribution robustness on 17 Out-of-distribution datasets aggregated (test) Source: [Out-of-distribution robustness on 17 Out-of-distribution datasets aggregated (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:54:05.232Z Evaluation of model robustness across an aggregated test set comprising 17 distinct out-of-distribution datasets. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Out-of-distribution robustness | | Dataset (including any stated split) | 17 Out-of-distribution datasets aggregated (test) | | Metric | OOD Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [OOD Accuracy](): Higher is better; unit: PERCENT. - [Rank](): Lower is better; unit: SCALAR. ## Recorded results | Method | OOD Accuracy | Result date | Report paper | | --- | --- | --- | --- | | ResNet-50 (VISSL) | 58.2 | Not recorded | 68fa6f291e209131cea44285 | | BC\_pruning-fraction-0.3 | 57.8 | Not recorded | 68fa6f291e209131cea44285 | | BC\_pruning-fraction-0.4 | 57.4 | Not recorded | 68fa6f291e209131cea44285 | | BC\_pruning-fraction-0.1 | 57.4 | Not recorded | 68fa6f291e209131cea44285 | | BC\_pruning-fraction-0.2 | 56.5 | Not recorded | 68fa6f291e209131cea44285 | | WC\_pruning-fraction-0.1 | 56.5 | Not recorded | 68fa6f291e209131cea44285 | | BC\_pruning-fraction-0.5 | 56 | Not recorded | 68fa6f291e209131cea44285 | | ResNet-50 (torchvision) | 55.9 | Not recorded | 68fa6f291e209131cea44285 | | WC\_pruning-fraction-0.2 | 55.6 | Not recorded | 68fa6f291e209131cea44285 | | WC\_pruning-fraction-0.3 | 54 | Not recorded | 68fa6f291e209131cea44285 | | WC\_pruning-fraction-0.4 | 51.6 | Not recorded | 68fa6f291e209131cea44285 | | WC\_pruning-fraction-0.5 | 49.8 | Not recorded | 68fa6f291e209131cea44285 | ### ResNet-50 (VISSL) OOD Accuracy: 58.2. Result ID: 699099d03a6c31484901c480. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Training":"VISSL"}. This record does not assert independent reproduction. ### BC\_pruning-fraction-0.3 OOD Accuracy: 57.8. Result ID: 699099d03a6c31484901c481. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Best-case (BC)","Pruning Fraction":"0.3"}. This record does not assert independent reproduction. ### BC\_pruning-fraction-0.4 OOD Accuracy: 57.4. Result ID: 699099d03a6c31484901c482. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Best-case (BC)","Pruning Fraction":"0.4"}. This record does not assert independent reproduction. ### BC\_pruning-fraction-0.1 OOD Accuracy: 57.4. Result ID: 699099d03a6c31484901c483. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Best-case (BC)","Pruning Fraction":"0.1"}. This record does not assert independent reproduction. ### BC\_pruning-fraction-0.2 OOD Accuracy: 56.5. Result ID: 699099d03a6c31484901c484. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Best-case (BC)","Pruning Fraction":"0.2"}. This record does not assert independent reproduction. ### WC\_pruning-fraction-0.1 OOD Accuracy: 56.5. Result ID: 699099d03a6c31484901c485. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Worst-case (WC)","Pruning Fraction":"0.1"}. This record does not assert independent reproduction. ### BC\_pruning-fraction-0.5 OOD Accuracy: 56. Result ID: 699099d03a6c31484901c486. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Best-case (BC)","Pruning Fraction":"0.5"}. This record does not assert independent reproduction. ### ResNet-50 (torchvision) OOD Accuracy: 55.9. Result ID: 699099d03a6c31484901c487. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Training":"torchvision"}. This record does not assert independent reproduction. ### WC\_pruning-fraction-0.2 OOD Accuracy: 55.6. Result ID: 699099d03a6c31484901c488. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Worst-case (WC)","Pruning Fraction":"0.2"}. This record does not assert independent reproduction. ### WC\_pruning-fraction-0.3 OOD Accuracy: 54. Result ID: 699099d03a6c31484901c489. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Worst-case (WC)","Pruning Fraction":"0.3"}. This record does not assert independent reproduction. ### WC\_pruning-fraction-0.4 OOD Accuracy: 51.6. Result ID: 699099d03a6c31484901c48a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Worst-case (WC)","Pruning Fraction":"0.4"}. This record does not assert independent reproduction. ### WC\_pruning-fraction-0.5 OOD Accuracy: 49.8. Result ID: 699099d03a6c31484901c48b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ResNet-50","Pruning Method":"Worst-case (WC)","Pruning Fraction":"0.5"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.