Timezone: »
Generating functions, which are widely used in combinatorics and probability theory, encode function values into the coefficients of a polynomial. In this paper, we explore their use as a tractable probabilistic model, and propose probabilistic generating circuits (PGCs) for their efficient representation. PGCs are strictly more expressive efficient than many existing tractable probabilistic models, including determinantal point processes (DPPs), probabilistic circuits (PCs) such as sum-product networks, and tractable graphical models. We contend that PGCs are not just a theoretical framework that unifies vastly different existing models, but also show great potential in modeling realistic data. We exhibit a simple class of PGCs that are not trivially subsumed by simple combinations of PCs and DPPs, and obtain competitive performance on a suite of density estimation benchmarks. We also highlight PGCs' connection to the theory of strongly Rayleigh distributions.
Author Information
Honghua Zhang (University of California, Los Angeles)
Brendan Juba (Washington University in St Louis)
Guy Van den Broeck (University of California, Los Angeles)
Related Events (a corresponding poster, oral, or spotlight)
-
2021 Oral: Probabilistic Generating Circuits »
Fri. Jul 23rd 12:00 -- 12:20 AM Room
More from the Same Authors
-
2023 Poster: Tractable Control for Auto-regressive Language Generation »
Honghua Zhang · Meihua Dang · Nanyun Peng · Guy Van den Broeck -
2023 Poster: Understanding the Distillation Process from Deep Generative Models to Tractable Probabilistic Circuits »
Xuejie Liu · Anji Liu · Guy Van den Broeck · Yitao Liang -
2023 Oral: Tractable Control for Auto-regressive Language Generation »
Honghua Zhang · Meihua Dang · Nanyun Peng · Guy Van den Broeck -
2022 : Session 3: New Computational Technologies for Reasoning »
Armando Solar-Lezama · Guy Van den Broeck · Jan-Willem van de Meent · Charles Sutton -
2022 : Provable Hierarchical Lifelong Learning with a Sketch-based Modular Architecture »
ZIHAO DENG · Zee Fryer · Brendan Juba · Rina Panigrahy · Xin Wang -
2020 : On the Relationship Between Probabilistic Circuits and Determinantal Point Processes »
Honghua Zhang · Steven Holtzen · Guy Van den Broeck -
2020 Poster: Einsum Networks: Fast and Scalable Learning of Tractable Probabilistic Circuits »
Robert Peharz · Steven Lang · Antonio Vergari · Karl Stelzner · Alejandro Molina · Martin Trapp · Guy Van den Broeck · Kristian Kersting · Zoubin Ghahramani -
2020 Poster: Scaling up Hybrid Probabilistic Inference with Logical and Arithmetic Constraints via Message Passing »
Zhe Zeng · Paolo Morettin · Fanqi Yan · Antonio Vergari · Guy Van den Broeck -
2018 Poster: Sound Abstraction and Decomposition of Probabilistic Programs »
Steven Holtzen · Guy Van den Broeck · Todd Millstein -
2018 Oral: Sound Abstraction and Decomposition of Probabilistic Programs »
Steven Holtzen · Guy Van den Broeck · Todd Millstein -
2018 Poster: A Semantic Loss Function for Deep Learning with Symbolic Knowledge »
Jingyi Xu · Zilu Zhang · Tal Friedman · Yitao Liang · Guy Van den Broeck -
2018 Oral: A Semantic Loss Function for Deep Learning with Symbolic Knowledge »
Jingyi Xu · Zilu Zhang · Tal Friedman · Yitao Liang · Guy Van den Broeck