Timezone: »
Poster
Stochastic Video Generation with a Learned Prior
Emily Denton · Rob Fergus
Generating video frames that accurately predict future world states is challenging. Existing approaches either fail to capture the full distribution of outcomes, or yield blurry generations, or both. In this paper we introduce a video generation model with a learned prior over stochastic latent variables at each time step. Video frames are generated by drawing samples from this prior and combining them with a deterministic estimate of the future frame. The approach is simple and easily trained end-to-end on a variety of datasets. Sample generations are both varied and sharp, even many frames into the future, and compare favorably to those from existing approaches.
Author Information
Emily Denton (New York University)
Rob Fergus (Facebook / NYU)
Related Events (a corresponding poster, oral, or spotlight)
-
2018 Oral: Stochastic Video Generation with a Learned Prior »
Fri. Jul 13th 02:40 -- 02:50 PM Room A7
More from the Same Authors
-
2023 : Accelerating exploration and representation learning with offline pre-training »
Bogdan Mazoure · Jake Bruce · Doina Precup · Rob Fergus · Ankit Anand -
2023 Poster: Distilling Internet-Scale Vision-Language Models into Embodied Agents »
Theodore R Sumers · Kenneth Marino · Arun Ahuja · Rob Fergus · Ishita Dasgupta -
2023 Poster: Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC »
Yilun Du · Conor Durkan · Robin Strudel · Josh Tenenbaum · Sander Dieleman · Rob Fergus · Jascha Sohl-Dickstein · Arnaud Doucet · Will Grathwohl -
2021 Oral: Decoupling Value and Policy for Generalization in Reinforcement Learning »
Roberta Raileanu · Rob Fergus -
2021 Poster: Decoupling Value and Policy for Generalization in Reinforcement Learning »
Roberta Raileanu · Rob Fergus -
2021 Poster: Reinforcement Learning with Prototypical Representations »
Denis Yarats · Rob Fergus · Alessandro Lazaric · Lerrel Pinto -
2021 Spotlight: Reinforcement Learning with Prototypical Representations »
Denis Yarats · Rob Fergus · Alessandro Lazaric · Lerrel Pinto -
2018 Poster: Modeling Others using Oneself in Multi-Agent Reinforcement Learning »
Roberta Raileanu · Emily Denton · Arthur Szlam · Facebook Rob Fergus -
2018 Oral: Modeling Others using Oneself in Multi-Agent Reinforcement Learning »
Roberta Raileanu · Emily Denton · Arthur Szlam · Facebook Rob Fergus