# Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablation

Source: [Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablation](<https://www.sota2.com/research/paper/68fa66ad1e209131cea11a8c>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:55:21.281Z

Authors: Alexander Levine, Soheil Feizi

Published: 2019-11-21T03:52:32.000Z

## Abstract

Recently, techniques have been developed to provably guarantee the robustness of a classifier to adversarial perturbations of bounded L\_1 and L\_2 magnitudes by using randomized smoothing: the robust classification is a consensus of base classifications on randomly noised samples where the noise is additive. In this paper, we extend this technique to the L\_0 threat model. We propose an efficient and certifiably robust defense against sparse adversarial attacks by randomly ablating input features, rather than using additive noise. Experimentally, on MNIST, we can certify the classifications of over 50% of images to be robust to any distortion of at most 8 pixels. This is comparable to the observed empirical robustness of unprotected classifiers on MNIST to modern L\_0 attacks, demonstrating the tightness of the proposed robustness certificate. We also evaluate our certificate on ImageNet and CIFAR-10. Our certificates represent an improvement on those provided in a concurrent work (Lee et al. 2019) which uses random noise rather than ablation (median certificates of 8 pixels versus 4 pixels on MNIST; 16 pixels versus 1 pixel on ImageNet.) Additionally, we empirically demonstrate that our classifier is highly robust to modern sparse adversarial attacks on MNIST. Our classifications are robust, in median, to adversarial perturbations of up to 31 pixels, compared to 22 pixels reported as the state-of-the-art defense, at the cost of a slight decrease (around 2.3%) in the classification accuracy. Code is available at https://github.com/alevine0/randomizedAblation/.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Image Classification on CIFAR-100 alpha=0.3 (test)](<https://www.sota2.com/research/sota/image-classification-on-cifar-100-alpha-0-3-test.md>): Image Classification; CIFAR-100 alpha=0.3 (test); Logit Flipping: 75.7.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1911.09272>)

[PDF](<https://arxiv.org/pdf/1911.09272.pdf>)
