Timezone: »

Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Network
Tristan Deleu · Mizu Nishikawa-Toomey · Jithendaraa Subramanian · Nikolay Malkin · Laurent Charlin · Yoshua Bengio
Event URL: https://openreview.net/forum?id=4NMp0QFqwH »

Generative Flow Networks (GFlowNets), a class of generative models over discrete and structured sample spaces, have been previously applied to the problem of inferring the marginal posterior distribution over the directed acyclic graph (DAG) of a Bayesian Network, given observations. Based on recent advances extending this framework to non-discrete sample spaces, we propose in this paper to approximate the joint posterior over not only the structure of a Bayesian Network, but also the parameters of its conditional probability distributions. We use a single GFlowNet whose sampling policy follows a two-phase process: the DAG is first generated sequentially one edge at a time, and then the corresponding parameters are picked once the full structure is known. Since the parameters are included in the posterior distribution, this leaves more flexibility for the local probability models of the Bayesian Network, making our approach applicable even to non-linear models parametrized by neural networks. We show that our method, called JSP-GFN, offers an accurate approximation of the joint posterior, while comparing favorably against existing methods on both simulated and real data.

Author Information

Tristan Deleu (Mila - Université de Montréal)
Mizu Nishikawa-Toomey (Montreal Institute for Learning Algorithms, University of Montreal, Université de Montréal)
Jithendaraa Subramanian (McGill University)
Nikolay Malkin (Mila / Université de Montréal)
Laurent Charlin (Mila)
Yoshua Bengio (Mila - Quebec AI Institute)

More from the Same Authors