Timezone: »

 
FACADE: A Framework for Adversarial Circuit Anomaly Detection and Evaluation
Dhruv Pai · Andres Carranza · Rylan Schaeffer · Arnuv Tandon · Sanmi Koyejo

@
in 2nd ICML Workshop on New Frontiers in Adversarial Machine Learning »
Event URL: https://openreview.net/forum?id=4j8KuZOmQH »

We present FACADE, a novel probabilistic and geometric framework designed for unsupervised mechanistic anomaly detection in deep neural networks. Its primary goal is advancing the understanding and mitigation of adversarial attacks. FACADE aims to generate probabilistic distributions over circuits, which provide critical insights to their contribution to changes in the manifold properties of pseudo-classes, or high-dimensional modes in activation space, yielding a powerful tool for uncovering and combating adversarial attacks. Our approach seeks to improve model robustness, enhance scalable model oversight, and demonstrates promising applications in real-world deployment settings.

Keywords: Deep Learning · Interpretability · Adversarial Robustness · Anomaly detection · Probabilistic Models

Author Information

Dhruv Pai (Computer Science Department, Stanford University)
Andres Carranza (Stanford University)
Andres Carranza

Hi! I'm Andres: a Colombian student studying at Stanford University interning at Two Sigma and previously at NASA.

Rylan Schaeffer (Stanford University)
Arnuv Tandon (Computer Science Department, Stanford University)
Sanmi Koyejo (Stanford University)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors