ICML 2023

Timezone: »

Visual Adversarial Examples Jailbreak Aligned Large Language Models

Xiangyu Qi · Kaixuan Huang · Ashwinee Panda · Mengdi Wang · Prateek Mittal

Fri Jul 28 05:00 PM -- 05:10 PM (PDT) @

in 2nd ICML Workshop on New Frontiers in Adversarial Machine Learning »

Event URL: https://openreview.net/forum?id=cZ4j7L6oui »

The growing interest in integrating vision into Large Language Models (LLMs), exemplified by Visual Language Models (VLMs) like Flamingo and GPT-4, is steering a convergence of vision and language foundation models. Yet, risks associated with this integration are largely unexamined. This paper sheds light on the security and safety implications of this trend. First, we underscore that the continuous and high-dimensional nature of the additional visual input makes it a weak link against adversarial attacks, representing an expanded attack surface of vision-integrated LLMs. Second, we highlight that the versatility of LLMs also presents visual attackers with a wider array of achievable adversarial objectives, extending the implications of security failures beyond mere misclassification. As an illustration, we present a case study in which we exploit visual adversarial examples to circumvent the safety guardrail of aligned LLMs with integrated vision. To our surprise, we discover that a single visual adversarial example can universally jailbreak an aligned model, inducing it to heed a wide range of harmful instructions and generate harmful content far beyond merely imitating the derogatory corpus used to optimize the adversarial example. Our study underscores the escalating adversarial risks associated with the pursuit of multimodality. More broadly, our findings connect the long-studied fundamental adversarial vulnerabilities of neural networks to the nascent field of AI alignment. The presented attack suggests a fundamental adversarial challenge for AI alignment, especially in light of the emerging trend towards multimodality in frontier foundation models.

Keywords: Adversarial Examples · large language models · foundation models · Visual Language Models

[ Poster] [ OpenReview]

Author Information

Xiangyu Qi (Princeton University)

Kaixuan Huang (Princeton University)

Ashwinee Panda (Princeton University)

Mengdi Wang (Princeton University)

Prateek Mittal (Princeton University)

Related Events (a corresponding poster, oral, or spotlight)

2023 : Introducing Vision into Large Language Models Expands Attack Surfaces and Failure Implications »
Dates n/a. Room