Motion-Residual Conflict-Aware Time Reversal for Generative Inbetweening
Abstract
Image-to-video (I2V) diffusion models have recently made generative inbetweening a practical reality by synthesizing semantically plausible intermediate frames between two keyframes. Among them, inference-time sampling schemes that re-use large pre-trained I2V backbones without any additional training are especially attractive. Yet current methods frequently exhibit temporal inconsistency and artifacts such as ghosting or reverse motion. A key reason is that the two trajectories are driven by distinct motion priors, each inherited from its own conditioning frame, and are simply stitched together without explicitly reconciling these priors. We introduce Motion-Residual Conflict-Aware Time Reversal (MR‑CATR), an inference-time sampling framework that aligns conflicting motion priors instead of discarding one of them or collapsing to a single start-conditioned prior. MR‑CATR first derives a motion-residual–based direction from the forward path, combined with an end-conditioned residual to form a consensus motion axis. This design suppresses bidirectional motion conflicts while still allowing end-frame information to refine the trajectory and enforce endpoint consistency. MR‑CATR can be seamlessly integrated into existing time-reversal samplers without changing model parameters. Experiments on generative inbetweening benchmarks show that our method produces videos with smoother motion, fewer artifacts, and consistently better quantitative scores and user preferences than prior strategies.
Lay Summary
This paper studies how to generate a smooth video between two given images, such as a starting frame and an ending frame. This task is useful for video editing and animation, but current methods often create visual problems such as ghosting, flickering, or motion that moves in an unnatural direction. The main difficulty is that the starting image and ending image may suggest different possible motions. Existing methods often combine these two sources of information too simply, which can make the generated video inconsistent. We propose MR-CATR, a method that helps the generation process make these motion directions more consistent. Instead of training a new video model, our method can be added to existing video generation methods during generation. It uses information from both input images to guide the video toward smoother and more coherent motion. Experiments show that MR-CATR produces videos with smoother transitions, fewer artifacts, and better agreement with both the starting and ending images. Human evaluations also show that people prefer the videos generated by our method.