Timezone: »

 
Poster
Hybrid Models with Deep and Invertible Features
Eric Nalisnick · Akihiro Matsukawa · Yee-Whye Teh · Dilan Gorur · Balaji Lakshminarayanan

Wed Jun 12 06:30 PM -- 09:00 PM (PDT) @ Pacific Ballroom #268
in Posters Wed »

We propose a neural hybrid model consisting of a linear model defined on a set of features computed by a deep, invertible transformation (i.e. a normalizing flow). An attractive property of our model is that both p(features), the density of the features, and p(targets|features), the predictive distribution, can be computed exactly in a single feed-forward pass. We show that our hybrid model, despite the invertibility constraints, achieves similar accuracy to purely predictive models. Yet the generative component remains a good model of the input features despite the hybrid optimization objective. This offers additional capabilities such as detection of out-of-distribution inputs and enabling semi-supervised learning. The availability of the exact joint density p(targets, features) also allows us to compute many quantities readily, making our hybrid model a useful building block for downstream applications of probabilistic deep learning.

Keywords: Bayesian Deep Learning · Deep Generative Models

Author Information

Eric Nalisnick (University of Cambridge & DeepMind)
Akihiro Matsukawa (DeepMind)
Yee-Whye Teh (Oxford and DeepMind)
Dilan Gorur
Balaji Lakshminarayanan (Google DeepMind)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors