Timezone: »

 
Workshop
Invertible Neural Networks and Normalizing Flows
Chin-Wei Huang · David Krueger · Rianne Van den Berg · George Papamakarios · Aidan Gomez · Chris Cremer · Aaron Courville · Tian Qi Chen · Danilo J. Rezende

Sat Jun 08:30 AM -- 06:00 PM PDT @ 103
Event URL: https://invertibleworkshop.github.io/ »

Invertible neural networks have been a significant thread of research in the ICML community for several years. Such transformations can offer a range of unique benefits:

(1) They preserve information, allowing perfect reconstruction (up to numerical limits) and obviating the need to store hidden activations in memory for backpropagation.
(2) They are often designed to track the changes in probability density that applying the transformation induces (as in normalizing flows).
(3) Like autoregressive models, normalizing flows can be powerful generative models which allow exact likelihood computations; with the right architecture, they can also allow for much cheaper sampling than autoregressive models.

While many researchers are aware of these topics and intrigued by several high-profile papers, few are familiar enough with the technical details to easily follow new developments and contribute. Many may also be unaware of the wide range of applications of invertible neural networks, beyond generative modelling and variational inference.

09:30 AM Tutorial on normalizing flows (Tutorial)|| Video »  Eric Jang
10:30 AM Poster Spotlights (Talk)||
10:50 AM poster session I (Poster session)||
Nicholas Rhinehart, Yunhao Tang, Vinay Prabhu, Dian Ang Yap, Alexander Wang, Marc Finzi, Manoj Kumar, You Lu, Abhishek Kumar, Qi Lei, Michael Przystupa, Nicola De Cao, Polina Kirichenko, Pavel Izmailov, Andrew Wilson, Jakob Kruse, Diego Mesquita, Mario Lezcano Casado, Thomas Müller, Keir Simmons, Andrei Atanov
11:30 AM Building a tractable generator network (Talk)|| Video » 
11:50 AM Glow: Generative Flow with Invertible 1x1 Convolutions (Talk)|| Video »  Prafulla Dhariwal
12:10 PM Contributed talk (Talk)|| Video » 
02:00 PM Householder meets Sylvester: Normalizing flows for variational inference (Talk)|| Video » 
02:20 PM Neural Ordinary Differential Equations for Continuous Normalizing Flows (Talk)|| Video » 
02:40 PM Contributed talk (Talk)|| Video » 
03:00 PM poster session II (Poster session)||
04:00 PM The Bijector API: An Invertible Function Library for TensorFlow (Talk)|| Video » 
04:20 PM Invertible Neural Networks for Understanding and Controlling Learned Representations (Talk)|| Video » 
04:40 PM Contributed talk (Talk)|| Video » 
05:00 PM Panel Session (Panel)|| Video » 

Author Information

Chin-Wei Huang (MILA)
David Krueger (Universit? de Montr?al)
Rianne Van den Berg (University of Amsterdam)
George Papamakarios (University of Edinburgh)
Aidan Gomez (University of Oxford)
Chris Cremer (University of Toronto)
Aaron Courville (Université de Montréal)
Ricky T. Q. Chen (U of Toronto)
Danilo J. Rezende (DeepMind)

More from the Same Authors