Speculative Sampling For Faster Molecular Dynamics
Abstract
Molecular dynamics (MD) is a key tool for simulating the dynamical behavior of atomic systems. However, MD is inherently serial, which makes it difficult to increase single-system throughput with concurrent compute. To address this, we introduce Langevin Speculative Dynamics (LSD), a distributed and model-agnostic speculative sampler for accelerating MD without adding relative error. Inspired by speculative methods in language and diffusion modeling, LSD uses a draft model to propose fast simulation steps and verifies them in parallel with a slower target model, applying a transport map from the draft to the target distribution. We extend speculative sampling to second-order Langevin dynamics, derive the achievable speedup as a function of physical parameters, show that LSD generalizes across different systems and draft-target combinations with a 3-9x speedup, and confirm theoretically and empirically that LSD samples trajectories from the same distribution as its target model.
Lay Summary
What if an untapped form of parallelism could make your molecular dynamics (MD) simulation several times faster – without sacrifices in accuracy? Our method of Langevin Speculative Dynamics (LSD) achieves this by breaking the traditional serial bottleneck of MD. By pairing a fast “draft” simulator with replicas of a slower, high-fidelity target model, LSD proposes a fast stream of time steps and verifies them in parallel – either accepting or overwriting them in a way that preserves the exact target distribution. The result is a substantial parallelism-driven speedup without any sampling bias. Formally, LSD extends the maximal coupling technique of speculative sampling, previously explored for LLMs and diffusion models, to the second-order Langevin integrators used in MD. We confirm both theoretically and empirically that LSD-drawn trajectories are indeed identically distributed to a standard serial simulation with the target model, all while achieving a 3–9× acceleration across diverse systems.