Overclocking Electrostatic Generative Models
Abstract
Lay Summary
Modern image-generation systems, such as diffusion models, can produce high-quality images but often require many computational steps to generate each sample. This makes them slow and expensive to use. This paper studies a newer family of physics-inspired generative models, called electrostatic generative models, which generate data by using ideas similar to electric fields. Although these models can achieve strong image quality, they also usually require costly simulations during sampling. We introduce Inverse Poisson Flow Matching (IPFM), a method for making these electrostatic generative models much faster. Instead of running the original model through many simulation steps, IPFM trains a smaller generator to imitate the behavior of the original model’s electrostatic field. This allows the model to generate images in only one or a few steps while keeping similar, and sometimes better, image quality. Our experiments show that IPFM can significantly reduce sampling cost on standard image-generation benchmarks. The results also suggest that finite-dimensional electrostatic models may be easier to distill than standard diffusion models, making them a promising direction for efficient generative modeling.