Timezone: »
Video prediction aims to generate realistic future frames by learning dynamic visual patterns. One fundamental challenge is to deal with future uncertainty: How should a model behave when there are multiple correct, equally probable future? We propose an Appearance-Motion Conditional GAN to address this challenge. We provide appearance and motion information as conditions that specify how the future may look like, reducing the level of uncertainty. Our model consists of a generator, two discriminators taking charge of appearance and motion pathways, and a perceptual ranking module that encourages videos of similar conditions to look similar. To train our model, we develop a novel conditioning scheme that consists of different combinations of appearance and motion conditions. We evaluate our model using facial expression and human action datasets and report favorable results compared to existing methods.
Author Information
Yunseok Jang (Seoul National University)
Gunhee Kim (Seoul National University)
Yale Song (Microsoft AI & Research)
Related Events (a corresponding poster, oral, or spotlight)
-
2018 Poster: Video Prediction with Appearance and Motion Conditions »
Fri. Jul 13th 04:15 -- 07:00 PM Room Hall B #158
More from the Same Authors
-
2021 Poster: Unsupervised Representation Learning via Neural Activation Coding »
Yookoon Park · Sangho Lee · Gunhee Kim · David Blei -
2021 Oral: Unsupervised Representation Learning via Neural Activation Coding »
Yookoon Park · Sangho Lee · Gunhee Kim · David Blei -
2021 Poster: Unsupervised Skill Discovery with Bottleneck Option Learning »
Jaekyeom Kim · Seohong Park · Gunhee Kim -
2021 Spotlight: Unsupervised Skill Discovery with Bottleneck Option Learning »
Jaekyeom Kim · Seohong Park · Gunhee Kim -
2019 Poster: Variational Laplace Autoencoders »
Yookoon Park · Chris Kim · Gunhee Kim -
2019 Oral: Variational Laplace Autoencoders »
Yookoon Park · Chris Kim · Gunhee Kim -
2019 Poster: Curiosity-Bottleneck: Exploration By Distilling Task-Specific Novelty »
Youngjin Kim · Daniel Nam · Hyunwoo Kim · Ji-Hoon Kim · Gunhee Kim -
2019 Oral: Curiosity-Bottleneck: Exploration By Distilling Task-Specific Novelty »
Youngjin Kim · Daniel Nam · Hyunwoo Kim · Ji-Hoon Kim · Gunhee Kim -
2017 Poster: SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization »
Juyong Kim · Yookoon Park · Gunhee Kim · Sung Ju Hwang -
2017 Talk: SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization »
Juyong Kim · Yookoon Park · Gunhee Kim · Sung Ju Hwang