Timezone: »
We propose efficient Langevin Monte Carlo algorithms for sampling distributions with nonsmooth convex composite potentials, which is the sum of a continuously differentiable function and a possibly nonsmooth function. We devise such algorithms leveraging recent advances in convex analysis and optimization methods involving Bregman divergences, namely the Bregman--Moreau envelopes and the Bregman proximity operators, and in the Langevin Monte Carlo algorithms reminiscent of mirror descent. The proposed algorithms extend existing Langevin Monte Carlo algorithms in two aspects---the ability to sample nonsmooth distributions with mirror descent-like algorithms, and the use of the more general Bregman--Moreau envelope in place of the Moreau envelope as a smooth approximation of the nonsmooth part of the potential. A particular case of the proposed scheme is reminiscent of the Bregman proximal gradient algorithm. The efficiency of the proposed methodology is illustrated with various sampling tasks at which existing Langevin Monte Carlo methods are known to perform poorly.
Author Information
Tim Tsz-Kit Lau (Northwestern University)
Han Liu (Northwestern)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopes »
Thu. Jul 21st through Fri the 22nd Room Hall E #729
More from the Same Authors
-
2023 Poster: Feature Programming for Multivariate Time Series Prediction »
Alex Reneau · Jerry Yao-Chieh Hu · Ammar Gilani · Han Liu -
2019 Poster: Global Convergence of Block Coordinate Descent in Deep Learning »
Jinshan ZENG · Tim Tsz-Kit Lau · Shaobo Lin · Yuan Yao -
2019 Oral: Global Convergence of Block Coordinate Descent in Deep Learning »
Jinshan ZENG · Tim Tsz-Kit Lau · Shaobo Lin · Yuan Yao -
2019 Poster: Grid-Wise Control for Multi-Agent Reinforcement Learning in Video Game AI »
Lei Han · Peng Sun · Yali Du · Jiechao Xiong · Qing Wang · Xinghai Sun · Han Liu · Tong Zhang -
2019 Oral: Grid-Wise Control for Multi-Agent Reinforcement Learning in Video Game AI »
Lei Han · Peng Sun · Yali Du · Jiechao Xiong · Qing Wang · Xinghai Sun · Han Liu · Tong Zhang -
2018 Poster: Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents »
Kaiqing Zhang · Zhuoran Yang · Han Liu · Tong Zhang · Tamer Basar -
2018 Oral: Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents »
Kaiqing Zhang · Zhuoran Yang · Han Liu · Tong Zhang · Tamer Basar -
2018 Poster: Feedback-Based Tree Search for Reinforcement Learning »
Daniel Jiang · Emmanuel Ekwedike · Han Liu -
2018 Oral: Feedback-Based Tree Search for Reinforcement Learning »
Daniel Jiang · Emmanuel Ekwedike · Han Liu