Timezone: »

 
Poster
Variational Implicit Processes
Chao Ma · Yingzhen Li · Jose Miguel Hernandez-Lobato

Wed Jun 12 06:30 PM -- 09:00 PM (PDT) @ Pacific Ballroom #225
in Posters Wed »

We introduce the implicit processes (IPs), a stochastic process that places implicitly defined multivariate distributions over any finite collections of random variables. IPs are therefore highly flexible implicit priors over \emph{functions}, with examples including data simulators, Bayesian neural networks and non-linear transformations of stochastic processes. A novel and efficient approximate inference algorithm for IPs, namely the variational implicit processes (VIPs), is derived using generalised wake-sleep updates. This method returns simple update equations and allows scalable hyper-parameter learning with stochastic optimization. Experiments show that VIPs return better uncertainty estimates and lower errors over existing inference methods for challenging models such as Bayesian neural networks, and Gaussian processes.

Keywords: Approximate Inference · Bayesian Deep Learning · Bayesian Nonparametrics · Gaussian Processes

Author Information

Chao Ma (University of Cambridge)
Yingzhen Li (Microsoft Research Cambridge)
Jose Miguel Hernandez-Lobato (University of Cambridge)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors