Timezone: »

Stochastic Video Generation with a Learned Prior
Emily Denton · Rob Fergus

Fri Jul 13 09:15 AM -- 12:00 PM (PDT) @ Hall B #56

Generating video frames that accurately predict future world states is challenging. Existing approaches either fail to capture the full distribution of outcomes, or yield blurry generations, or both. In this paper we introduce a video generation model with a learned prior over stochastic latent variables at each time step. Video frames are generated by drawing samples from this prior and combining them with a deterministic estimate of the future frame. The approach is simple and easily trained end-to-end on a variety of datasets. Sample generations are both varied and sharp, even many frames into the future, and compare favorably to those from existing approaches.

Author Information

Emily Denton (New York University)
Rob Fergus (Facebook / NYU)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors