# Investigating the Semantic Robustness of CLIP-based Zero-Shot Anomaly Segmentation

Source: [Investigating the Semantic Robustness of CLIP-based Zero-Shot Anomaly Segmentation](<https://www.sota2.com/research/paper/68fa73321e209131cea5b164>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:44:18.752Z

Authors: Kevin Stangl, Marius Arvinte, Weilin Xu, Cory Cornelius

Published: 2024-05-13T17:47:08.000Z

## Abstract

Zero-shot anomaly segmentation using pre-trained foundation models is a promising approach that enables effective algorithms without expensive, domain-specific training or fine-tuning. Ensuring that these methods work across various environmental conditions and are robust to distribution shifts is an open problem. We investigate the performance of WinCLIP \[14\] zero-shot anomaly segmentation algorithm by perturbing test data using three semantic transformations: bounded angular rotations, bounded saturation shifts, and hue shifts. We empirically measure a lower performance bound by aggregating across per-sample worst-case perturbations and find that average performance drops by up to 20% in area under the ROC curve and 40% in area under the per-region overlap curve. We find that performance is consistently lowered on three CLIP backbones, regardless of model architecture or learning objective, demonstrating a need for careful performance evaluation.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2405.07969>)

[PDF](<https://arxiv.org/pdf/2405.07969.pdf>)
