We study probabilistic models of natural images and extend the autoregressive family of PixelCNN models by incorporating auxiliary variables. Subsequently, we describe two new generative image models that exploit different image transformations as auxiliary variables: a quantized grayscale view of the image or a multi-resolution image pyramid. The proposed models tackle two known shortcomings of existing PixelCNN models: 1) their tendency to focus on low-level image details, while largely ignoring high-level image information, such as object shapes, and 2) their computationally costly procedure for image sampling. We experimentally demonstrate benefits of our models, in particular showing that they produce much more realistically looking image samples than previous state-of-the-art probabilistic models.
Summary/Notes »Author Information
Alexander Kolesnikov (IST Austria)
Christoph H. Lampert (IST Austria)
Related Events (a corresponding poster, oral, or spotlight)
-
2017 Talk: PixelCNN Models with Auxiliary Variables for Natural Image Modeling »
Mon Aug 7th 10:30 -- 10:48 AM Room Parkside 1
More from the Same Authors
-
2019 Poster: Robust Learning from Untrusted Sources »
Nikola Konstantinov · Christoph H. Lampert -
2019 Poster: Towards Understanding Knowledge Distillation »
Mary Phuong · Christoph H. Lampert -
2019 Oral: Towards Understanding Knowledge Distillation »
Mary Phuong · Christoph H. Lampert -
2019 Oral: Robust Learning from Untrusted Sources »
Nikola Konstantinov · Christoph H. Lampert -
2018 Poster: Learning equations for extrapolation and control »
Subham S Sahoo · Christoph H. Lampert · Georg Martius -
2018 Oral: Learning equations for extrapolation and control »
Subham S Sahoo · Christoph H. Lampert · Georg Martius -
2018 Poster: Data-Dependent Stability of Stochastic Gradient Descent »
Ilja Kuzborskij · Christoph H. Lampert -
2018 Oral: Data-Dependent Stability of Stochastic Gradient Descent »
Ilja Kuzborskij · Christoph H. Lampert -
2017 Poster: Multi-task Learning with Labeled and Unlabeled Tasks »
Anastasia Pentina · Christoph H. Lampert -
2017 Talk: Multi-task Learning with Labeled and Unlabeled Tasks »
Anastasia Pentina · Christoph H. Lampert
