Timezone: »
Natural data observed in R^n is often constrained to an m-dimensional manifold M, where m < n. Current generative models represent this manifold by mapping an m-dimensional latent variable through a neural network f : R^m → R^n. Such procedures, which we call pushforward models, incur a straightforward limitation:manifolds cannot in general be represented with a single parameterization, meaning that attempts to do so will incur either computational instability or the inability to learn probability densities within the manifold. To remedy this problem, we propose to model M as a "neural implicit manifold": the set of zeros of a neural network. To learn the data distribution within M, we introduce the "constrained energy-based model," which uses a constrained variant of Langevin dynamics to train and sample within the learned manifold. The resulting model can be manipulated with an "arithmetic of manifolds" which allows practitioners to take unions and intersections of model manifolds. In experiments on synthetic and natural data, we show that constrained EBMs can learn manifold-supported distributions with complex topologies more accurately than pushforward models.
Author Information
Brendan Ross (Layer 6 AI)
Gabriel Loaiza-Ganem (Layer 6 AI)
Anthony Caterini (Layer 6 AI)
Jesse Cresswell (Layer 6 AI)
More from the Same Authors
-
2021 : Conformal Embedding Flows: Tractable Density Estimation on Learned Manifolds »
Brendan Ross -
2023 Poster: TR0N: Translator Networks for 0-Shot Plug-and-Play Conditional Generation »
Zhaoyan Liu · Noël Vouitsis · Satya Krishna Gorti · Jimmy Ba · Gabriel Loaiza-Ganem -
2022 Poster: Bayesian Nonparametrics for Offline Skill Discovery »
Valentin Villecroze · Harry Braviner · Panteha Naderian · Chris Maddison · Gabriel Loaiza-Ganem -
2022 Spotlight: Bayesian Nonparametrics for Offline Skill Discovery »
Valentin Villecroze · Harry Braviner · Panteha Naderian · Chris Maddison · Gabriel Loaiza-Ganem -
2020 Poster: The continuous categorical: a novel simplex-valued exponential family »
Elliott Gordon-Rodriguez · Gabriel Loaiza-Ganem · John Cunningham