Timezone: »
Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in generative modeling. Fueled by its flexibility in the formulation and strong modeling power of the latent space, recent works built upon it have made interesting attempts aiming at the interpretability of text modeling. However, latent space EBMs also inherit some flaws from EBMs in data space; the degenerate MCMC sampling quality in practice can lead to poor generation quality and instability in training, especially on data with complex latent structures. Inspired by the recent efforts that leverage diffusion recovery likelihood learning as a cure for the sampling issue, we introduce a novel symbiosis between the diffusion models and latent space EBMs in a variational learning framework, coined as the latent diffusion energy-based model. We develop a geometric clustering-based regularization jointly with the information bottleneck to further improve the quality of the learned latent space. Experiments on several challenging tasks demonstrate the superior performance of our model on interpretable text modeling over strong counterparts.
Author Information
Peiyu Yu (University of California, Los Angeles)
Sirui Xie (UCLA)
Xiaojian Ma (Tsinghua University)
Xiaojian Ma is a senior undergraduate student at Tsinghua University and will be an incoming graduate student at the University of California, Los Angeles working with Prof. Song-chun Zhu. Previously he has been a visiting student at the National University of Singapore, with Prof. Gim Hee Lee. He also spends time at Tencent AI Lab, mentored by Dr. Wenbing Huang. His research interest including machine learning in general (statistical learning, learning theory, and reinforcement learning) and its application in robotics (imitation learning, optimal control, manipulation, grasping and multimodel sensing). Some of his research has been accepted as full papers or workshop papers to top-tier machine learning and robotics conferences as AAAI/ICRA/IROS/CVPR.
Baoxiong Jia (UCLA)
Bo Pang (University of California Los Angeles)
Ruiqi Gao (UCLA)
Yixin Zhu (Peking University)
Song-Chun Zhu (UCLA)
Ying Nian Wu (UCLA)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Spotlight: Latent Diffusion Energy-Based Model for Interpretable Text Modelling »
Tue. Jul 19th 02:45 -- 02:50 PM Room Room 301 - 303
More from the Same Authors
-
2023 Poster: Diverse and Faithful Knowledge-Grounded Dialogue Generation via Sequential Posterior Inference »
Yan Xu · Deqian Kong · Dehong Xu · Ziwei Ji · Bo Pang · Pascale FUNG · Ying Nian Wu -
2023 Poster: On the Complexity of Bayesian Generalization »
Yu-Zhe Shi · Manjie Xu · John Hopcroft · Kun He · Josh Tenenbaum · Song-Chun Zhu · Ying Nian Wu · Wenjuan Han · Yixin Zhu -
2022 Poster: COAT: Measuring Object Compositionality in Emergent Representations »
Sirui Xie · Ari Morcos · Song-Chun Zhu · Shanmukha Ramakrishna Vedantam -
2022 Spotlight: COAT: Measuring Object Compositionality in Emergent Representations »
Sirui Xie · Ari Morcos · Song-Chun Zhu · Shanmukha Ramakrishna Vedantam -
2021 : [12:02 - 12:47 PM UTC] Invited Talk 1: Explainable AI: How Machines Gain Justified Trust from Humans »
Song-Chun Zhu -
2021 Workshop: ICML Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI »
Quanshi Zhang · Tian Han · Lixin Fan · Zhanxing Zhu · Hang Su · Ying Nian Wu -
2021 Poster: Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classification »
Bo Pang · Ying Nian Wu -
2021 Spotlight: Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classification »
Bo Pang · Ying Nian Wu -
2020 Poster: Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning »
Qing Li · Siyuan Huang · Yining Hong · Yixin Chen · Ying Nian Wu · Song-Chun Zhu -
2018 Poster: Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction »
Siyuan Qi · Baoxiong Jia · Song-Chun Zhu -
2018 Oral: Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction »
Siyuan Qi · Baoxiong Jia · Song-Chun Zhu