# Low-Pass Filtering Improves Behavioral Alignment of Vision Models

Source: [Low-Pass Filtering Improves Behavioral Alignment of Vision Models](<https://www.sota2.com/research/paper/6993f5fa9ebc499c974099f4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-18T05:00:04.391Z

Authors: Max Wolff, Thomas Klein, Evgenia Rusak, Felix Wichmann, Wieland Brendel

Published: 2026-02-14T19:42:57.000Z

## Abstract

Despite their impressive performance on computer vision benchmarks, Deep Neural Networks (DNNs) still fall short of adequately modeling human visual behavior, as measured by error consistency and shape bias. Recent work hypothesized that behavioral alignment can be drastically improved through \\emph{generative} -- rather than \\emph{discriminative} -- classifiers, with far-reaching implications for models of human vision.   Here, we instead show that the increased alignment of generative models can be largely explained by a seemingly innocuous resizing operation in the generative model which effectively acts as a low-pass filter. In a series of controlled experiments, we show that removing high-frequency spatial information from discriminative models like CLIP drastically increases their behavioral alignment. Simply blurring images at test-time -- rather than training on blurred images -- achieves a new state-of-the-art score on the model-vs-human benchmark, halving the current alignment gap between DNNs and human observers. Furthermore, low-pass filters are likely optimal, which we demonstrate by directly optimizing filters for alignment. To contextualize the performance of optimal filters, we compute the frontier of all possible pareto-optimal solutions to the benchmark, which was formerly unknown.   We explain our findings by observing that the frequency spectrum of optimal Gaussian filters roughly matches the spectrum of band-pass filters implemented by the human visual system. We show that the contrast sensitivity function, describing the inverse of the contrast threshold required for humans to detect a sinusoidal grating as a function of spatiotemporal frequency, is approximated well by Gaussian filters of the specific width that also maximizes error consistency.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Model-Human Comparison on model-vs-human (test)](<https://www.sota2.com/research/sota/model-human-comparison-on-model-vs-human-test.md>): Model-Human Comparison; model-vs-human (test); Error Consistency: 0.38.

- [Image Classification on model-vs-human OOD Aggregate (test)](<https://www.sota2.com/research/sota/image-classification-on-model-vs-human-ood-aggregate-test.md>): Image Classification; model-vs-human OOD Aggregate (test); OOD Accuracy: 75.

- [Shape-Texture Bias Evaluation on model-vs-human Cue-conflict (test)](<https://www.sota2.com/research/sota/shape-texture-bias-evaluation-on-model-vs-human-cue-conflict-test.md>): Shape-Texture Bias Evaluation; model-vs-human Cue-conflict (test); Shape Bias: 96.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2602.13859>)

[PDF](<https://arxiv.org/pdf/2602.13859.pdf>)
