Timezone: »
Despite the success of equivariant neural networks in scientific applications, they require knowing the symmetry group a priori. However, it may be difficult to know which symmetry to use as an inductive bias in practice. Enforcing the wrong symmetry could even hurt the performance. In this paper, we propose a framework, LieGAN, to *automatically discover equivariances* from a dataset using a paradigm akin to generative adversarial training. Specifically, a generator learns a group of transformations applied to the data, which preserve the original distribution and fool the discriminator. LieGAN represents symmetry as interpretable Lie algebra basis and can discover various symmetries such as the rotation group $\mathrm{SO}(n)$, restricted Lorentz group $\mathrm{SO}(1,3)^+$ in trajectory prediction and top-quark tagging tasks. The learned symmetry can also be readily used in several existing equivariant neural networks to improve accuracy and generalization in prediction.
Author Information
Jianke Yang (University of California, San Diego)
Robin Walters (Northeastern University)
Nima Dehmamy (MIT-IBM Lab)
Physicist working on equivariant neural networks, Symmetries of the loss landscape, graph neural networks, and computational social science.
Rose Yu (University of California, San Diego)

Dr. Rose Yu is an assistant professor at the University of California San Diego, Department of Computer Science and Engineering. She earned her Ph.D. in Computer Sciences at USC in 2017. She was subsequently a Postdoctoral Fellow at Caltech. Her research focuses on advancing machine learning techniques for large-scale spatiotemporal data analysis, with applications to sustainability, health, and physical sciences. A particular emphasis of her research is on physics-guided AI which aims to integrate first principles with data-driven models. Among her awards, she has won NSF CAREER Award, Faculty Research Award from JP Morgan, Facebook, Google, Amazon, and Adobe, Several Best Paper Awards, Best Dissertation Award at USC, and was nominated as one of the ’MIT Rising Stars in EECS’.
More from the Same Authors
-
2022 : Data Augmentation vs. Equivariant Networks: A Theoretical Study of Generalizability on Dynamics Forecasting »
Rui Wang · Robin Walters · Rose Yu -
2023 : Unsupervised Learning of 3-colorings using Simplicial Higher-Order Neural Networks »
Lucas Laird · Robin Walters · Wolfgang Gatterbauer -
2023 : Latent Space Symmetry Discovery »
Jianke Yang · Nima Dehmamy · Robin Walters · Rose Yu -
2023 : Can Euclidean Symmetry Help in Reinforcement Learning and Planning »
Linfeng Zhao · Owen Howell · Jung Yeon Park · Xupeng Zhu · Robin Walters · Lawson Wong -
2023 Poster: On the Connection Between MPNN and Graph Transformer »
Chen Cai · Truong Son Hy · Rose Yu · Yusu Wang -
2023 Poster: Disentangled Multi-Fidelity Deep Bayesian Active Learning »
Dongxia Wu · Ruijia Niu · Matteo Chinazzi · Yian Ma · Rose Yu -
2022 Poster: Toward Compositional Generalization in Object-Oriented World Modeling »
Linfeng Zhao · Lingzhi Kong · Robin Walters · Lawson Wong -
2022 Oral: Toward Compositional Generalization in Object-Oriented World Modeling »
Linfeng Zhao · Lingzhi Kong · Robin Walters · Lawson Wong -
2022 Poster: LIMO: Latent Inceptionism for Targeted Molecule Generation »
Peter Eckmann · Kunyang Sun · Bo Zhao · Mudong Feng · Michael Gilson · Rose Yu -
2022 Poster: Learning Symmetric Embeddings for Equivariant World Models »
Jung Yeon Park · Ondrej Biza · Linfeng Zhao · Jan-Willem van de Meent · Robin Walters -
2022 Spotlight: Learning Symmetric Embeddings for Equivariant World Models »
Jung Yeon Park · Ondrej Biza · Linfeng Zhao · Jan-Willem van de Meent · Robin Walters -
2022 Spotlight: LIMO: Latent Inceptionism for Targeted Molecule Generation »
Peter Eckmann · Kunyang Sun · Bo Zhao · Mudong Feng · Michael Gilson · Rose Yu -
2022 Poster: Approximately Equivariant Networks for Imperfectly Symmetric Dynamics »
Rui Wang · Robin Walters · Rose Yu -
2022 Spotlight: Approximately Equivariant Networks for Imperfectly Symmetric Dynamics »
Rui Wang · Robin Walters · Rose Yu -
2021 : RL + Robotics Panel »
George Konidaris · Jan Peters · Martin Riedmiller · Angela Schoellig · Rose Yu · Rupam Mahmood -
2020 Poster: Multiresolution Tensor Learning for Efficient and Interpretable Spatial Analysis »
Jung Yeon Park · Kenneth Carr · Stephan Zheng · Yisong Yue · Rose Yu