Timezone: »
The kernel exponential family is a rich class of distributions, which can be fit efficiently and with statistical guarantees by score matching. Being required to choose a priori a simple kernel such as the Gaussian, however, limits its practical applicability. We provide a scheme for learning a kernel parameterized by a deep network, which can find complex location-dependent local features of the data geometry. This gives a very rich class of density models, capable of fitting complex structures on moderate-dimensional problems. Compared to deep density models fit via maximum likelihood, our approach provides a complementary set of strengths and tradeoffs: in empirical studies, the former can yield higher likelihoods, whereas the latter gives better estimates of the gradient of the log density, the score, which describes the distribution's shape.
Author Information
Li Kevin Wenliang (Gatsby Unit, University College London)
D.J. Sutherland (Gatsby unit, University College London)
Heiko Strathmann (University College London)
Arthur Gretton (Gatsby Computational Neuroscience Unit)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Poster: Learning deep kernels for exponential family densities »
Wed. Jun 12th 01:30 -- 04:00 AM Room Pacific Ballroom #221
More from the Same Authors
-
2022 : Adapting to Shifts in Latent Confounders via Observed Concepts and Proxies »
Matt Kusner · Ibrahim Alabdulmohsin · Stephen Pfohl · Olawale Salaudeen · Arthur Gretton · Sanmi Koyejo · Jessica Schrouff · Alexander D'Amour -
2023 Poster: Memory-Based Meta-Learning on Non-Stationary Distributions »
Tim Genewein · Gregoire Deletang · Anian Ruoss · Li Kevin Wenliang · Elliot Catt · Vincent Dutordoir · Jordi Grau-Moya · Laurent Orseau · Marcus Hutter · Joel Veness -
2023 Poster: A Kernel Stein Test of Goodness of Fit for Sequential Models »
Jerome Baum · Heishiro Kanagawa · Arthur Gretton -
2022 Poster: Importance Weighted Kernel Bayes' Rule »
Liyuan Xu · Yutian Chen · Arnaud Doucet · Arthur Gretton -
2022 Spotlight: Importance Weighted Kernel Bayes' Rule »
Liyuan Xu · Yutian Chen · Arnaud Doucet · Arthur Gretton -
2021 Poster: Proximal Causal Learning with Kernels: Two-Stage Estimation and Moment Restriction »
Afsaneh Mastouri · Yuchen Zhu · Limor Gultchin · Anna Korba · Ricardo Silva · Matt J. Kusner · Arthur Gretton · Krikamol Muandet -
2021 Spotlight: Proximal Causal Learning with Kernels: Two-Stage Estimation and Moment Restriction »
Afsaneh Mastouri · Yuchen Zhu · Limor Gultchin · Anna Korba · Ricardo Silva · Matt J. Kusner · Arthur Gretton · Krikamol Muandet -
2021 Oral: NeRF-VAE: A Geometry Aware 3D Scene Generative Model »
Adam Kosiorek · Heiko Strathmann · Daniel Zoran · Pol Moreno · Rosalia Schneider · Sona Mokra · Danilo J. Rezende -
2021 Poster: NeRF-VAE: A Geometry Aware 3D Scene Generative Model »
Adam Kosiorek · Heiko Strathmann · Daniel Zoran · Pol Moreno · Rosalia Schneider · Sona Mokra · Danilo J. Rezende -
2020 Poster: Amortised Learning by Wake-Sleep »
Li Kevin Wenliang · Theodore Moskovitz · Heishiro Kanagawa · Maneesh Sahani -
2020 Poster: Kernelized Stein Discrepancy Tests of Goodness-of-fit for Time-to-Event Data »
Tamara Fernandez · Arthur Gretton · Nicolas Rivera · Wenkai Xu -
2020 Poster: Learning Deep Kernels for Non-Parametric Two-Sample Tests »
Feng Liu · Wenkai Xu · Jie Lu · Guangquan Zhang · Arthur Gretton · D.J. Sutherland -
2019 : Invited Talk - Arthur Gretton: Relative goodness-of-fit tests for models with latent variables. »
Arthur Gretton -
2017 Poster: An Adaptive Test of Independence with Analytic Kernel Embeddings »
Wittawat Jitkrittum · Zoltan Szabo · Arthur Gretton -
2017 Talk: An Adaptive Test of Independence with Analytic Kernel Embeddings »
Wittawat Jitkrittum · Zoltan Szabo · Arthur Gretton