Timezone: »
Graphical models with latent count variables arise in a number of areas. However, standard inference algorithms do not apply to these models due to the infinite support of the latent variables. Winner and Sheldon (2016) recently developed a new technique using probability generating functions (PGFs) to perform efficient, exact inference for certain Poisson latent variable models. However, the method relies on symbolic manipulation of PGFs, and it is unclear whether this can be extended to more general models. In this paper we introduce a new approach for inference with PGFs: instead of manipulating PGFs symbolically, we adapt techniques from the autodiff literature to compute the higher-order derivatives necessary for inference. This substantially generalizes the class of models for which efficient, exact inference algorithms are available. Specifically, our results apply to a class of models that includes branching processes, which are widely used in applied mathematics and population ecology, and autoregressive models for integer data. Experiments show that our techniques are more scalable than existing approximate methods and enable new applications.
Author Information
Kevin Winner (University of Massachusetts, Amherst)
Debora Sujono (University of Massachusetts Amherst)
Daniel Sheldon (University of Massachusetts Amherst)
Related Events (a corresponding poster, oral, or spotlight)
-
2017 Talk: Exact Inference for Integer Latent-Variable Models »
Tue. Aug 8th 12:48 -- 01:06 AM Room C4.9& C4.10
More from the Same Authors
-
2023 Poster: Automatically marginalized MCMC in probabilistic programming »
Jinlin Lai · Javier Burroni · Hui Guan · Daniel Sheldon -
2019 : AI for Ecology and Conservation »
Daniel Sheldon -
2019 Poster: Graphical-model based estimation and inference for differential privacy »
Ryan McKenna · Daniel Sheldon · Gerome Miklau -
2019 Oral: Graphical-model based estimation and inference for differential privacy »
Ryan McKenna · Daniel Sheldon · Gerome Miklau -
2018 Poster: Learning in Integer Latent Variable Models with Nested Automatic Differentiation »
Daniel Sheldon · Kevin Winner · Debora Sujono -
2018 Oral: Learning in Integer Latent Variable Models with Nested Automatic Differentiation »
Daniel Sheldon · Kevin Winner · Debora Sujono -
2017 Poster: Differentially Private Learning of Graphical Models using CGMs »
Garrett Bernstein · Ryan McKenna · Tao Sun · Daniel Sheldon · Michael Hay · Gerome Miklau -
2017 Talk: Differentially Private Learning of Graphical Models using CGMs »
Garrett Bernstein · Ryan McKenna · Tao Sun · Daniel Sheldon · Michael Hay · Gerome Miklau