# A Meta-Analysis of Distributionally-Robust Models

Source: [A Meta-Analysis of Distributionally-Robust Models](<https://www.sota2.com/research/paper/68fa6cbe1e209131cea35bbf>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:17:38.470Z

Authors: Benjamin Feuer, Ameya Joshi, Chinmay Hegde

Published: 2022-06-15T14:31:17.000Z

## Abstract

State-of-the-art image classifiers trained on massive datasets (such as ImageNet) have been shown to be vulnerable to a range of both intentional and incidental distribution shifts. On the other hand, several recent classifiers with favorable out-of-distribution (OOD) robustness properties have emerged, achieving high accuracy on their target tasks while maintaining their in-distribution accuracy on challenging benchmarks. We present a meta-analysis on a wide range of publicly released models, most of which have been published over the last twelve months. Through this meta-analysis, we empirically identify four main commonalities for all the best-performing OOD-robust models, all of which illuminate the considerable promise of vision-language pre-training.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2206.07565>)

[PDF](<https://arxiv.org/pdf/2206.07565.pdf>)
