Timezone: »
Generalizing Adversarial Training to Composite Semantic Perturbations
Yun-Yun Tsai · Lei Hsiung · Pin-Yu Chen · Tsung-Yi Ho
Model robustness against adversarial examples has been widely studied, yet the lack of generalization to more realistic scenarios can be challenging. Specifically, recent works using adversarial training can successfully improve model robustness, but these works primarily consider adversarial threat models limited to $\ell_{p}$-norm bounded perturbations and might overlook semantic perturbations and their composition. In this paper, we firstly propose a novel method for generating composite adversarial examples. By utilizing component-wise PGD update and automatic attack- order scheduling, our method can find the optimal attack composition. We then propose generalized adversarial training (GAT) to extend model robustness from $\ell_{p}$ norm to composite semantic perturbations, such as Hue, Saturation, Brightness, Contrast, and Rotation. The results show that GAT can be robust not only on any single attack but also on combination of multiple attacks. GAT also outperforms baseline adversarial training approaches by a significant margin.
Author Information
Yun-Yun Tsai (Columbia University)
Lei Hsiung (National Tsing Hua University)
Pin-Yu Chen (IBM Research AI)
Tsung-Yi Ho (National Tsing Hua University)
More from the Same Authors
-
2021 : On the Effectiveness of Poisoning against Unsupervised Domain Adaptation »
Akshay Mehra · Bhavya Kailkhura · Pin-Yu Chen · Jihun Hamm -
2021 Poster: Parallel Droplet Control in MEDA Biochips using Multi-Agent Reinforcement Learning »
Tung-Che Liang · Jin Zhou · Yun-Sheng Chan · Tsung-Yi Ho · Krishnendu Chakrabarty · Cy Lee -
2021 Spotlight: Parallel Droplet Control in MEDA Biochips using Multi-Agent Reinforcement Learning »
Tung-Che Liang · Jin Zhou · Yun-Sheng Chan · Tsung-Yi Ho · Krishnendu Chakrabarty · Cy Lee -
2021 Poster: Voice2Series: Reprogramming Acoustic Models for Time Series Classification »
Huck Yang · Yun-Yun Tsai · Pin-Yu Chen -
2021 Spotlight: Voice2Series: Reprogramming Acoustic Models for Time Series Classification »
Huck Yang · Yun-Yun Tsai · Pin-Yu Chen -
2020 Poster: Adaptive Droplet Routing in Digital Microfluidic Biochips Using Deep Reinforcement Learning »
Tung-Che Liang · Zhanwei Zhong · Yaas Bigdeli · Tsung-Yi Ho · Krishnendu Chakrabarty · Richard Fair -
2020 Poster: Transfer Learning without Knowing: Reprogramming Black-box Machine Learning Models with Scarce Data and Limited Resources »
Yun Yun Tsai · Pin-Yu Chen · Tsung-Yi Ho