Timezone: »

 
Adversarial Semantic Contour for Object Detection
Yichi Zhang · Zijian Zhu · Xiao Yang · Jun Zhu

@
in A Blessing in Disguise: The Prospects and Perils of Adversarial Machine Learning »
Modern object detectors are vulnerable to adversarial examples, which brings potential risks to numerous applications, e.g., self-driving car. Among attacks regularized by $\ell_p$ norm, $\ell_0$-attack aims to modify as few pixels as possible. Nevertheless, the problem is nontrivial since it generally requires to optimize the shape along with the texture simultaneously, which is an NP-hard problem. To address this issue, we propose a novel method of Adversarial Semantic Contour (ASC) guided by object contour as prior. With this prior, we reduce the searching space to accelerate the $\ell_0$ optimization, and also introduce more semantic information which should affect the detectors more. Based on the contour, we optimize the selection of modified pixels via sampling and their colors with gradient descent alternately. Extensive experiments demonstrate that our proposed ASC outperforms the most commonly manually designed patterns (e.g., square patches and grids) on task of disappearing. By modifying no more than 5\% and 3.5\% of the object area respectively, our proposed ASC can successfully mislead the mainstream object detectors including the SSD512, Yolov4, Mask RCNN, Faster RCNN, etc.
Keywords: Architectures

Author Information

Yichi Zhang (Tsinghua University, Tsinghua University)
Zijian Zhu (Shanghai Jiao Tong University, Tsinghua University)
Xiao Yang (Tsinghua University, Tsinghua University)
Jun Zhu (Tsinghua University)

More from the Same Authors