Timezone: »
Poster
Variational Annealing of GANs: A Langevin Perspective
Chenyang Tao · Shuyang Dai · Liqun Chen · Ke Bai · Junya Chen · Chang Liu · RUIYI (ROY) ZHANG · Georgiy Bobashev · Lawrence Carin
The generative adversarial network (GAN) has received considerable attention recently as a model for data synthesis, without an explicit specification of a likelihood function. There has been commensurate interest in leveraging likelihood estimates to improve GAN training. To enrich the understanding of this fast-growing yet almost exclusively heuristic-driven subject, we elucidate the theoretical roots of some of the empirical attempts to stabilize and improve GAN training with the introduction of likelihoods. We highlight new insights from variational theory of diffusion processes to derive a likelihood-based regularizing scheme for GAN training, and present a novel approach to train GANs with an unnormalized distribution instead of empirical samples. To substantiate our claims, we provide experimental evidence on how our theoretically-inspired new algorithms improve upon current practice.
Author Information
Chenyang Tao (Duke University)
Shuyang Dai (Duke University)
Liqun Chen (Duke University)
Ke Bai (Duke University)
Junya Chen (Duke U)
Chang Liu (Tsinghua University)
RUIYI (ROY) ZHANG (Duke University)
Georgiy Bobashev (RTI International)
Lawrence Carin (Duke)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Oral: Variational Annealing of GANs: A Langevin Perspective »
Wed. Jun 12th 07:15 -- 07:20 PM Room Hall A
More from the Same Authors
-
2021 : Hölder Bounds for Sensitivity Analysis in Causal Reasoning »
Serge Assaad · Shuxi Zeng · Henry Pfister · Fan Li · Lawrence Carin -
2020 Poster: Learning Autoencoders with Relational Regularization »
Hongteng Xu · Dixin Luo · Ricardo Henao · Svati Shah · Lawrence Carin -
2020 Poster: Graph Optimal Transport for Cross-Domain Alignment »
Liqun Chen · Zhe Gan · Yu Cheng · Linjie Li · Lawrence Carin · Jingjing Liu -
2020 Poster: On Leveraging Pretrained GANs for Generation with Limited Data »
Miaoyun Zhao · Yulai Cong · Lawrence Carin -
2020 Poster: CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information »
Pengyu Cheng · Weituo Hao · Shuyang Dai · Jiachang Liu · Zhe Gan · Lawrence Carin -
2019 : Invited Talk - Ruiyi Zhang: On Wasserstein Gradient Flows and Particle-Based Variational Inference »
RUIYI (ROY) ZHANG -
2019 Poster: Gromov-Wasserstein Learning for Graph Matching and Node Embedding »
Hongteng Xu · Dixin Luo · Hongyuan Zha · Lawrence Carin -
2019 Oral: Gromov-Wasserstein Learning for Graph Matching and Node Embedding »
Hongteng Xu · Dixin Luo · Hongyuan Zha · Lawrence Carin -
2019 Poster: Stochastic Blockmodels meet Graph Neural Networks »
Nikhil Mehta · Lawrence Carin · Piyush Rai -
2019 Poster: Understanding and Accelerating Particle-Based Variational Inference »
Chang Liu · Jingwei Zhuo · Pengyu Cheng · RUIYI (ROY) ZHANG · Jun Zhu -
2019 Oral: Stochastic Blockmodels meet Graph Neural Networks »
Nikhil Mehta · Lawrence Carin · Piyush Rai -
2019 Oral: Understanding and Accelerating Particle-Based Variational Inference »
Chang Liu · Jingwei Zhuo · Pengyu Cheng · RUIYI (ROY) ZHANG · Jun Zhu -
2019 Poster: Understanding MCMC Dynamics as Flows on the Wasserstein Space »
Chang Liu · Jingwei Zhuo · Jun Zhu -
2019 Oral: Understanding MCMC Dynamics as Flows on the Wasserstein Space »
Chang Liu · Jingwei Zhuo · Jun Zhu -
2018 Poster: Message Passing Stein Variational Gradient Descent »
Jingwei Zhuo · Chang Liu · Jiaxin Shi · Jun Zhu · Ning Chen · Bo Zhang -
2018 Poster: Learning Registered Point Processes from Idiosyncratic Observations »
Hongteng Xu · Lawrence Carin · Hongyuan Zha -
2018 Poster: Policy Optimization as Wasserstein Gradient Flows »
RUIYI (ROY) ZHANG · Changyou Chen · Chunyuan Li · Lawrence Carin -
2018 Poster: JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets »
Yunchen Pu · Shuyang Dai · Zhe Gan · Weiyao Wang · Guoyin Wang · Yizhe Zhang · Ricardo Henao · Lawrence Carin -
2018 Oral: Message Passing Stein Variational Gradient Descent »
Jingwei Zhuo · Chang Liu · Jiaxin Shi · Jun Zhu · Ning Chen · Bo Zhang -
2018 Oral: Policy Optimization as Wasserstein Gradient Flows »
RUIYI (ROY) ZHANG · Changyou Chen · Chunyuan Li · Lawrence Carin -
2018 Oral: JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets »
Yunchen Pu · Shuyang Dai · Zhe Gan · Weiyao Wang · Guoyin Wang · Yizhe Zhang · Ricardo Henao · Lawrence Carin -
2018 Oral: Learning Registered Point Processes from Idiosyncratic Observations »
Hongteng Xu · Lawrence Carin · Hongyuan Zha -
2018 Poster: Adversarial Time-to-Event Modeling »
Paidamoyo Chapfuwa · Chenyang Tao · Chunyuan Li · Courtney Page · Benjamin Goldstein · Lawrence Carin · Ricardo Henao -
2018 Oral: Adversarial Time-to-Event Modeling »
Paidamoyo Chapfuwa · Chenyang Tao · Chunyuan Li · Courtney Page · Benjamin Goldstein · Lawrence Carin · Ricardo Henao -
2018 Poster: Continuous-Time Flows for Efficient Inference and Density Estimation »
Changyou Chen · Chunyuan Li · Liquan Chen · Wenlin Wang · Yunchen Pu · Lawrence Carin -
2018 Poster: Chi-square Generative Adversarial Network »
Chenyang Tao · Liqun Chen · Ricardo Henao · Jianfeng Feng · Lawrence Carin -
2018 Poster: Variational Inference and Model Selection with Generalized Evidence Bounds »
Liqun Chen · Chenyang Tao · RUIYI (ROY) ZHANG · Ricardo Henao · Lawrence Carin -
2018 Oral: Chi-square Generative Adversarial Network »
Chenyang Tao · Liqun Chen · Ricardo Henao · Jianfeng Feng · Lawrence Carin -
2018 Oral: Continuous-Time Flows for Efficient Inference and Density Estimation »
Changyou Chen · Chunyuan Li · Liquan Chen · Wenlin Wang · Yunchen Pu · Lawrence Carin -
2018 Oral: Variational Inference and Model Selection with Generalized Evidence Bounds »
Liqun Chen · Chenyang Tao · RUIYI (ROY) ZHANG · Ricardo Henao · Lawrence Carin -
2017 Poster: Stochastic Gradient Monomial Gamma Sampler »
Yizhe Zhang · Changyou Chen · Zhe Gan · Ricardo Henao · Lawrence Carin -
2017 Poster: Adversarial Feature Matching for Text Generation »
Yizhe Zhang · Zhe Gan · Kai Fan · Zhi Chen · Ricardo Henao · Dinghan Shen · Lawrence Carin -
2017 Talk: Adversarial Feature Matching for Text Generation »
Yizhe Zhang · Zhe Gan · Kai Fan · Zhi Chen · Ricardo Henao · Dinghan Shen · Lawrence Carin -
2017 Talk: Stochastic Gradient Monomial Gamma Sampler »
Yizhe Zhang · Changyou Chen · Zhe Gan · Ricardo Henao · Lawrence Carin -
2017 Poster: Deep Generative Models for Relational Data with Side Information »
Changwei Hu · Piyush Rai · Lawrence Carin -
2017 Talk: Deep Generative Models for Relational Data with Side Information »
Changwei Hu · Piyush Rai · Lawrence Carin