Timezone: »

 
Poster
Score-Guided Intermediate Level Optimization: Fast Langevin Mixing for Inverse Problems
Giannis Daras · Yuval Dagan · Alexandros Dimakis · Constantinos Daskalakis

Wed Jul 20 03:30 PM -- 05:30 PM (PDT) @ Hall E #207
in Poster Session 2 »

We prove fast mixing and characterize the stationary distribution of the Langevin Algorithm for inverting random weighted DNN generators. This result extends the work of Hand and Voroninski from efficient inversion to efficient posterior sampling. In practice, to allow for increased expressivity, we propose to do posterior sampling in the latent space of a pre-trained generative model. To achieve that, we train a score-based model in the latent space of a StyleGAN-2 and we use it to solve inverse problems.Our framework, Score-Guided Intermediate Layer Optimization (SGILO), extends prior work by replacing the sparsity regularization with a generative prior in the intermediate layer. Experimentally, we obtain significant improvements over the previous state-of-the-art, especially in the low measurement regime.

Keywords: DL: Generative Models and Autoencoders · DL: Theory · OPT: Sampling and Optimization · PM: Monte Carlo and Sampling Methods

Author Information

Giannis Daras (The University of Texas at Austin)
Yuval Dagan (MIT)
Alexandros Dimakis (UT Austin)

Alex Dimakis is an Associate Professor at the Electrical and Computer Engineering department, University of Texas at Austin. He received his Ph.D. in electrical engineering and computer sciences from UC Berkeley. He received an ARO young investigator award in 2014, the NSF Career award in 2011, a Google faculty research award in 2012 and the Eli Jury dissertation award in 2008. He is the co-recipient of several best paper awards including the joint Information Theory and Communications Society Best Paper Award in 2012. His research interests include information theory, coding theory and machine learning.

Constantinos Daskalakis (MIT)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors