Skip to yearly menu bar Skip to main content


Adversarial Examples Are a Natural Consequence of Test Error in Noise

Justin Gilmer · Nicolas Ford · Nicholas Carlini · Ekin Dogus Cubuk

Pacific Ballroom #93

Keywords: [ Deep Learning Theory ] [ Adversarial Examples ]

Over the last few years, the phenomenon of \emph{adversarial examples} --- maliciously constructed inputs that fool trained machine learning models --- has captured the attention of the research community, especially when restricted to small modifications of a correctly handled input. Less surprisingly, image classifiers also lack human-level performance on randomly corrupted images, such as images with additive Gaussian noise. In this paper we provide both empirical and theoretical evidence that these are two manifestations of the same underlying phenomenon, and therefore the adversarial robustness and corruption robustness research programs are closely related. This suggests that improving adversarial robustness should go hand in hand with improving performance in the presence of more general and realistic image corruptions. This yields a computationally tractable evaluation metric for defenses to consider: test error in noisy image distributions.

Live content is unavailable. Log in and register to view live content